11/22/2024 11:18:25 AM UTC [INFO] Listening for events... 
11/22/2024 11:18:25 AM UTC [INFO] Press Ctrl-C to stop.
11/22/2024 11:19:58 AM UTC [INFO] Received an event for node: 6740688411fb139cb87df65e
11/22/2024 11:19:58 AM UTC [DEBUG] Sending to KCIDB: checkouts: maestro:6740688411fb139cb87df65e
11/22/2024 11:20:18 AM UTC [INFO] Received an event for node: 674068de11fb139cb87df661
11/22/2024 11:20:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: shell
11/22/2024 11:20:18 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e
11/22/2024 11:20:18 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:674068de11fb139cb87df661
11/22/2024 11:23:02 AM UTC [INFO] Received an event for node: 674068eb11fb139cb87df6a0
11/22/2024 11:23:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:57 AM UTC [ERROR] HTTPSConnectionPool(host='kciapistagingstorage1.file.core.windows.net', port=443): Max retries exceeded with url: /staging/kunit-x86_64-674068eb11fb139cb87df6a0/test_log?sv=2022-11-02&ss=f&srt=sco&sp=r&se=2026-10-18T13:36:18Z&st=2024-10-17T05:36:18Z&spr=https&sig=xFxYOOh5uXJWeN9I3YKAUvpGGQivo89HKZbD78gcxvc%3D (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7fa5d73c7310>: Failed to resolve 'kciapistagingstorage1.file.core.windows.net' ([Errno -2] Name or service not known)"))
11/22/2024 11:23:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:23:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:49 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:24:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:00 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:03 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:04 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:05 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:06 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:07 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:08 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:09 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:10 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:11 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:12 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:13 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:14 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:15 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:16 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:17 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:18 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:19 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:20 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:21 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:22 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:23 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:24 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:25 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:26 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:27 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:28 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:29 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:30 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:31 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:32 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:33 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:36 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:37 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:38 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:39 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:40 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:41 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:42 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:43 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:44 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:45 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:46 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:47 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:48 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:50 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:51 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:52 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:53 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:54 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:55 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:56 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:57 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:58 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740688411fb139cb87df65e_x86_64
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:674068eb11fb139cb87df6a0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6b3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6b4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6b7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6b9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6bb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6bc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6bd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6be
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6bf
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6c9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ca
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6cb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6cc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6cd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ce
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6cf
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6d9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6da
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6db
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6dc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6dd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6de
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6df
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6e9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ea
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6eb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ec
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ee
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ef
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6f9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6fa
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6fb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6fc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6fd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6fe
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df6ff
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df700
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df701
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df702
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df703
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df704
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df706
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df707
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df709
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df70b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df70d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df70e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df70f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df710
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df711
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df712
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df713
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df714
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df716
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df717
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df719
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df71f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df720
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df721
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df722
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df723
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df724
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df726
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df727
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df729
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df72a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df72c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df72d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df72f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df730
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df731
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df733
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df735
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df736
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df737
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df738
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df73a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df73b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df73d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df73e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df73f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df740
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df741
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df742
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df743
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df744
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df745
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df746
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df747
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df748
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df74f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df750
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df751
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df752
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df753
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df754
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df756
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df757
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df758
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df759
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df75a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df75b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df75c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df75d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df75f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df760
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df761
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df762
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df765
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df766
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df767
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df768
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df769
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df76a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df76b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df76c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df76d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df76f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df770
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df772
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df773
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df774
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df775
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df776
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df778
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df779
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df77b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df77c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df77d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df77e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df77f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df780
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df781
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df782
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df783
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df784
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df785
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df786
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df787
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df788
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df789
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df78f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df790
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df791
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df792
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df793
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df794
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df795
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df796
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df797
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df798
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df799
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df79f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7a9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7aa
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ab
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ac
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ad
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ae
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7af
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7b9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ba
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7bb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7bc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7bd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7bf
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7c9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ca
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7cb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7cc
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ce
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7cf
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7d9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7da
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7db
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7dd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7de
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7df
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7e9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ea
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7eb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ec
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ed
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ee
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ef
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f0
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f1
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f2
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f3
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f4
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f5
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f6
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f7
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f8
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7f9
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7fa
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7fb
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7fd
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7fe
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df7ff
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df800
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df801
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df802
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df803
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df804
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df805
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df806
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df807
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df808
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df809
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df80f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df810
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df811
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df812
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df813
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df814
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df815
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df816
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df817
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df818
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df819
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df81f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df820
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df821
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df822
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df823
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df824
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df825
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df826
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df827
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df828
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df829
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df82f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df830
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df831
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df832
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df833
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df834
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df835
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df836
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df837
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df838
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df839
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df83a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df83b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df83c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df83d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df83f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df840
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df841
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df842
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df843
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df844
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df845
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df846
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df847
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df848
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df849
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df84f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df850
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df851
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df852
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df853
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df854
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df855
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df856
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df857
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df858
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df85a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df85c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df85d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df85e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df85f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df861
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df862
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699511fb139cb87df863
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df865
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df866
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df867
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df869
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86a
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86b
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86c
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86d
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86e
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df86f
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df871
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df872
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df873
11/22/2024 11:25:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740699611fb139cb87df874
11/22/2024 11:26:00 AM UTC [INFO] Received an event for node: 674068e811fb139cb87df68e
11/22/2024 11:26:01 AM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3325c6b50845f46be6bff7f0e0342d66dc4e64fe', 'issue_id': 'maestro:9a0380e65981a08cbddde11435a587780d3ce582', 'issue_version': 0, 'build_id': 'maestro:674068e811fb139cb87df68e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:26:01 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e811fb139cb87df68e
11/22/2024 11:26:01 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3325c6b50845f46be6bff7f0e0342d66dc4e64fe
11/22/2024 11:26:01 AM UTC [INFO] Received an event for node: 673707494a42ae04dfb85c8d
11/22/2024 11:26:01 AM UTC [DEBUG] Not sending node to KCIDB: 673707494a42ae04dfb85c8d
11/22/2024 11:26:01 AM UTC [INFO] Received an event for node: 674068e811fb139cb87df68e
11/22/2024 11:26:02 AM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3325c6b50845f46be6bff7f0e0342d66dc4e64fe', 'issue_id': 'maestro:9a0380e65981a08cbddde11435a587780d3ce582', 'issue_version': 0, 'build_id': 'maestro:674068e811fb139cb87df68e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:26:02 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e811fb139cb87df68e
11/22/2024 11:26:02 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3325c6b50845f46be6bff7f0e0342d66dc4e64fe
11/22/2024 11:26:02 AM UTC [INFO] Received an event for node: 673707494a42ae04dfb85c90
11/22/2024 11:26:02 AM UTC [DEBUG] Not sending node to KCIDB: 673707494a42ae04dfb85c90
11/22/2024 11:26:02 AM UTC [INFO] Received an event for node: 674069e511fb139cb87df876
11/22/2024 11:26:02 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:26:02 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:674069e511fb139cb87df876
11/22/2024 11:26:02 AM UTC [INFO] Received an event for node: 674068e011fb139cb87df667
11/22/2024 11:26:03 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e011fb139cb87df667
11/22/2024 11:26:03 AM UTC [INFO] Received an event for node: 674068e911fb139cb87df691
11/22/2024 11:26:03 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e911fb139cb87df691
11/22/2024 11:27:00 AM UTC [INFO] Received an event for node: 674068e711fb139cb87df688
11/22/2024 11:27:01 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e711fb139cb87df688
11/22/2024 11:27:24 AM UTC [INFO] Received an event for node: 674068e611fb139cb87df685
11/22/2024 11:27:25 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e611fb139cb87df685
11/22/2024 11:27:26 AM UTC [INFO] Received an event for node: 6740405a7b0bd642f4d9fe9e
11/22/2024 11:27:26 AM UTC [DEBUG] Sending to KCIDB: checkouts: maestro:6740405a7b0bd642f4d9fe9e
11/22/2024 11:27:37 AM UTC [INFO] Received an event for node: 674068eb11fb139cb87df69d
11/22/2024 11:27:37 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068eb11fb139cb87df69d
11/22/2024 11:27:40 AM UTC [INFO] Received an event for node: 674068e711fb139cb87df68b
11/22/2024 11:27:41 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e711fb139cb87df68b
11/22/2024 11:28:06 AM UTC [INFO] Received an event for node: 674068e911fb139cb87df697
11/22/2024 11:28:06 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e911fb139cb87df697
11/22/2024 11:29:04 AM UTC [INFO] Received an event for node: 674068e411fb139cb87df679
11/22/2024 11:29:04 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e411fb139cb87df679
11/22/2024 11:31:04 AM UTC [INFO] Received an event for node: 674068e611fb139cb87df682
11/22/2024 11:31:05 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e611fb139cb87df682
11/22/2024 11:31:14 AM UTC [INFO] Received an event for node: 674068e211fb139cb87df670
11/22/2024 11:31:15 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e211fb139cb87df670
11/22/2024 11:33:43 AM UTC [INFO] Received an event for node: 674068df11fb139cb87df664
11/22/2024 11:33:44 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068df11fb139cb87df664
11/22/2024 11:35:28 AM UTC [INFO] Received an event for node: 674068e211fb139cb87df66d
11/22/2024 11:35:28 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e211fb139cb87df66d
11/22/2024 11:36:33 AM UTC [INFO] Received an event for node: 674068e911fb139cb87df694
11/22/2024 11:36:34 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e911fb139cb87df694
11/22/2024 11:36:34 AM UTC [INFO] Received an event for node: 67406cc111fb139cb87df898
11/22/2024 11:36:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:36:34 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:36:34 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc111fb139cb87df898
11/22/2024 11:36:35 AM UTC [INFO] Received an event for node: 67406cc211fb139cb87df89b
11/22/2024 11:36:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:36:35 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:36:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc211fb139cb87df89b
11/22/2024 11:37:02 AM UTC [INFO] Received an event for node: 674068e311fb139cb87df676
11/22/2024 11:37:02 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e311fb139cb87df676
11/22/2024 11:37:35 AM UTC [INFO] Received an event for node: 674068ea11fb139cb87df69a
11/22/2024 11:37:36 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068ea11fb139cb87df69a
11/22/2024 11:37:51 AM UTC [INFO] Received an event for node: 67406cc311fb139cb87df89e
11/22/2024 11:37:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc311fb139cb87df89e
11/22/2024 11:37:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaa6
11/22/2024 11:37:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaa7
11/22/2024 11:37:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaa8
11/22/2024 11:38:11 AM UTC [INFO] Received an event for node: 67406cca11fb139cb87df8ce
11/22/2024 11:38:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cca11fb139cb87df8ce
11/22/2024 11:38:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2311fb139cb87dfb12
11/22/2024 11:38:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2311fb139cb87dfb13
11/22/2024 11:38:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2311fb139cb87dfb14
11/22/2024 11:38:18 AM UTC [INFO] Received an event for node: 67406cc711fb139cb87df8b3
11/22/2024 11:38:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc711fb139cb87df8b3
11/22/2024 11:38:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2a11fb139cb87dfb28
11/22/2024 11:38:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2a11fb139cb87dfb29
11/22/2024 11:38:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2a11fb139cb87dfb2a
11/22/2024 11:38:22 AM UTC [INFO] Received an event for node: 67406ccb11fb139cb87df8d4
11/22/2024 11:38:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccb11fb139cb87df8d4
11/22/2024 11:38:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2e11fb139cb87dfb48
11/22/2024 11:38:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2e11fb139cb87dfb49
11/22/2024 11:38:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2e11fb139cb87dfb4a
11/22/2024 11:38:25 AM UTC [INFO] Received an event for node: 674068ee11fb139cb87df6a6
11/22/2024 11:38:25 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068ee11fb139cb87df6a6
11/22/2024 11:38:26 AM UTC [INFO] Received an event for node: 67406ccc11fb139cb87df8da
11/22/2024 11:38:28 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccc11fb139cb87df8da
11/22/2024 11:38:28 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2f11fb139cb87dfb5b
11/22/2024 11:38:28 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2f11fb139cb87dfb5c
11/22/2024 11:38:28 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2f11fb139cb87dfb5d
11/22/2024 11:38:30 AM UTC [INFO] Received an event for node: 67406cd411fb139cb87df910
11/22/2024 11:38:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd411fb139cb87df910
11/22/2024 11:38:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3611fb139cb87dfb76
11/22/2024 11:38:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3611fb139cb87dfb77
11/22/2024 11:38:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3611fb139cb87dfb78
11/22/2024 11:38:33 AM UTC [INFO] Received an event for node: 67406cd711fb139cb87df922
11/22/2024 11:38:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd711fb139cb87df922
11/22/2024 11:38:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb80
11/22/2024 11:38:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb81
11/22/2024 11:38:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb82
11/22/2024 11:38:36 AM UTC [INFO] Received an event for node: 67406cd711fb139cb87df925
11/22/2024 11:38:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd711fb139cb87df925
11/22/2024 11:38:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb88
11/22/2024 11:38:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb89
11/22/2024 11:38:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb8a
11/22/2024 11:38:38 AM UTC [INFO] Received an event for node: 67406cd511fb139cb87df916
11/22/2024 11:38:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd511fb139cb87df916
11/22/2024 11:38:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfb96
11/22/2024 11:38:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfb97
11/22/2024 11:38:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfb98
11/22/2024 11:38:41 AM UTC [INFO] Received an event for node: 67406cd311fb139cb87df907
11/22/2024 11:38:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd311fb139cb87df907
11/22/2024 11:38:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfba1
11/22/2024 11:38:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfba2
11/22/2024 11:38:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfba3
11/22/2024 11:38:44 AM UTC [INFO] Received an event for node: 67406cd111fb139cb87df8f8
11/22/2024 11:38:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd111fb139cb87df8f8
11/22/2024 11:38:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbb6
11/22/2024 11:38:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbb7
11/22/2024 11:38:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbb8
11/22/2024 11:38:47 AM UTC [INFO] Received an event for node: 67406ccf11fb139cb87df8ec
11/22/2024 11:38:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccf11fb139cb87df8ec
11/22/2024 11:38:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbbe
11/22/2024 11:38:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbbf
11/22/2024 11:38:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3d11fb139cb87dfbc0
11/22/2024 11:38:50 AM UTC [INFO] Received an event for node: 67406ccd11fb139cb87df8e3
11/22/2024 11:38:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccd11fb139cb87df8e3
11/22/2024 11:38:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3f11fb139cb87dfbc6
11/22/2024 11:38:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3f11fb139cb87dfbc7
11/22/2024 11:38:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3f11fb139cb87dfbc8
11/22/2024 11:38:53 AM UTC [INFO] Received an event for node: 67406cd611fb139cb87df91c
11/22/2024 11:38:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd611fb139cb87df91c
11/22/2024 11:38:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4111fb139cb87dfbce
11/22/2024 11:38:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4111fb139cb87dfbcf
11/22/2024 11:38:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4111fb139cb87dfbd0
11/22/2024 11:38:56 AM UTC [INFO] Received an event for node: 67406cd011fb139cb87df8f2
11/22/2024 11:38:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd011fb139cb87df8f2
11/22/2024 11:38:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4211fb139cb87dfbd6
11/22/2024 11:38:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4211fb139cb87dfbd7
11/22/2024 11:38:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4211fb139cb87dfbd8
11/22/2024 11:38:59 AM UTC [INFO] Received an event for node: 673ff3f6a1a3e2eddf852757
11/22/2024 11:38:59 AM UTC [DEBUG] Not sending node to KCIDB: 673ff3f6a1a3e2eddf852757
11/22/2024 11:38:59 AM UTC [INFO] Received an event for node: 673ff410a1a3e2eddf85275a
11/22/2024 11:38:59 AM UTC [DEBUG] Not sending node to KCIDB: 673ff410a1a3e2eddf85275a
11/22/2024 11:38:59 AM UTC [INFO] Received an event for node: 673ff42ea1a3e2eddf85275d
11/22/2024 11:38:59 AM UTC [DEBUG] Not sending node to KCIDB: 673ff42ea1a3e2eddf85275d
11/22/2024 11:38:59 AM UTC [INFO] Received an event for node: 673ff44aa1a3e2eddf852760
11/22/2024 11:38:59 AM UTC [DEBUG] Not sending node to KCIDB: 673ff44aa1a3e2eddf852760
11/22/2024 11:38:59 AM UTC [INFO] Received an event for node: 67406cc611fb139cb87df8b0
11/22/2024 11:39:02 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc611fb139cb87df8b0
11/22/2024 11:39:02 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4811fb139cb87dfbe2
11/22/2024 11:39:02 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4811fb139cb87dfbe3
11/22/2024 11:39:02 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4811fb139cb87dfbe4
11/22/2024 11:39:02 AM UTC [INFO] Received an event for node: 67406ccd11fb139cb87df8e0
11/22/2024 11:39:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccd11fb139cb87df8e0
11/22/2024 11:39:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4911fb139cb87dfbea
11/22/2024 11:39:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4911fb139cb87dfbeb
11/22/2024 11:39:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4911fb139cb87dfbec
11/22/2024 11:39:05 AM UTC [INFO] Received an event for node: 67406cc711fb139cb87df8b6
11/22/2024 11:39:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc711fb139cb87df8b6
11/22/2024 11:39:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4a11fb139cb87dfbf2
11/22/2024 11:39:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4a11fb139cb87dfbf3
11/22/2024 11:39:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4a11fb139cb87dfbf4
11/22/2024 11:39:08 AM UTC [INFO] Received an event for node: 67406cca11fb139cb87df8cb
11/22/2024 11:39:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cca11fb139cb87df8cb
11/22/2024 11:39:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfbfa
11/22/2024 11:39:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfbfb
11/22/2024 11:39:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfbfc
11/22/2024 11:39:11 AM UTC [INFO] Received an event for node: 67406cce11fb139cb87df8e6
11/22/2024 11:39:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cce11fb139cb87df8e6
11/22/2024 11:39:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfc02
11/22/2024 11:39:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfc03
11/22/2024 11:39:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4d11fb139cb87dfc04
11/22/2024 11:39:14 AM UTC [INFO] Received an event for node: 67406cd111fb139cb87df8fb
11/22/2024 11:39:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd111fb139cb87df8fb
11/22/2024 11:39:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4e11fb139cb87dfc0a
11/22/2024 11:39:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4e11fb139cb87dfc0b
11/22/2024 11:39:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4e11fb139cb87dfc0c
11/22/2024 11:39:17 AM UTC [INFO] Received an event for node: 674068ef11fb139cb87df6a9
11/22/2024 11:39:18 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068ef11fb139cb87df6a9
11/22/2024 11:39:18 AM UTC [INFO] Received an event for node: 67406cd211fb139cb87df8fe
11/22/2024 11:39:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd211fb139cb87df8fe
11/22/2024 11:39:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5011fb139cb87dfc16
11/22/2024 11:39:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5011fb139cb87dfc17
11/22/2024 11:39:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5011fb139cb87dfc18
11/22/2024 11:39:21 AM UTC [INFO] Received an event for node: 67406cd211fb139cb87df901
11/22/2024 11:39:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd211fb139cb87df901
11/22/2024 11:39:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5111fb139cb87dfc24
11/22/2024 11:39:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5111fb139cb87dfc25
11/22/2024 11:39:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5111fb139cb87dfc26
11/22/2024 11:39:24 AM UTC [INFO] Received an event for node: 67406cd011fb139cb87df8f5
11/22/2024 11:39:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd011fb139cb87df8f5
11/22/2024 11:39:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5511fb139cb87dfc35
11/22/2024 11:39:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5511fb139cb87dfc36
11/22/2024 11:39:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5511fb139cb87dfc37
11/22/2024 11:39:27 AM UTC [INFO] Received an event for node: 67406cc711fb139cb87df8b9
11/22/2024 11:39:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc711fb139cb87df8b9
11/22/2024 11:39:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5a11fb139cb87dfc49
11/22/2024 11:39:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5a11fb139cb87dfc4a
11/22/2024 11:39:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5a11fb139cb87dfc4b
11/22/2024 11:39:30 AM UTC [INFO] Received an event for node: 67406ccf11fb139cb87df8ef
11/22/2024 11:39:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccf11fb139cb87df8ef
11/22/2024 11:39:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc5a
11/22/2024 11:39:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc5b
11/22/2024 11:39:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc5c
11/22/2024 11:39:33 AM UTC [INFO] Received an event for node: 67406cc811fb139cb87df8bf
11/22/2024 11:39:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc811fb139cb87df8bf
11/22/2024 11:39:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc63
11/22/2024 11:39:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc64
11/22/2024 11:39:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5e11fb139cb87dfc65
11/22/2024 11:39:36 AM UTC [INFO] Received an event for node: 67406ccb11fb139cb87df8d1
11/22/2024 11:39:39 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccb11fb139cb87df8d1
11/22/2024 11:39:39 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc74
11/22/2024 11:39:39 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc75
11/22/2024 11:39:39 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc76
11/22/2024 11:39:39 AM UTC [INFO] Received an event for node: 67406cd311fb139cb87df90a
11/22/2024 11:39:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd311fb139cb87df90a
11/22/2024 11:39:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc7c
11/22/2024 11:39:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc7d
11/22/2024 11:39:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6211fb139cb87dfc7e
11/22/2024 11:39:41 AM UTC [INFO] Received an event for node: 67406cd211fb139cb87df904
11/22/2024 11:39:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd211fb139cb87df904
11/22/2024 11:39:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc84
11/22/2024 11:39:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc85
11/22/2024 11:39:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc86
11/22/2024 11:39:44 AM UTC [INFO] Received an event for node: 67406cca11fb139cb87df8c8
11/22/2024 11:39:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cca11fb139cb87df8c8
11/22/2024 11:39:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc8c
11/22/2024 11:39:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc8d
11/22/2024 11:39:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc8e
11/22/2024 11:39:47 AM UTC [INFO] Received an event for node: 67406cc811fb139cb87df8bc
11/22/2024 11:39:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc811fb139cb87df8bc
11/22/2024 11:39:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc94
11/22/2024 11:39:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc95
11/22/2024 11:39:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6311fb139cb87dfc96
11/22/2024 11:39:49 AM UTC [INFO] Received an event for node: 67406cc911fb139cb87df8c5
11/22/2024 11:39:52 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc911fb139cb87df8c5
11/22/2024 11:39:52 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6411fb139cb87dfc9c
11/22/2024 11:39:52 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6411fb139cb87dfc9d
11/22/2024 11:39:52 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6411fb139cb87dfc9e
11/22/2024 11:39:52 AM UTC [INFO] Received an event for node: 67406ccc11fb139cb87df8d7
11/22/2024 11:39:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccc11fb139cb87df8d7
11/22/2024 11:39:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6811fb139cb87dfca4
11/22/2024 11:39:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6811fb139cb87dfca5
11/22/2024 11:39:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6811fb139cb87dfca6
11/22/2024 11:39:55 AM UTC [INFO] Received an event for node: 67406cc511fb139cb87df8a7
11/22/2024 11:39:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc511fb139cb87df8a7
11/22/2024 11:39:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcac
11/22/2024 11:39:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcad
11/22/2024 11:39:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcae
11/22/2024 11:39:58 AM UTC [INFO] Received an event for node: 67406ccc11fb139cb87df8dd
11/22/2024 11:40:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ccc11fb139cb87df8dd
11/22/2024 11:40:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcb4
11/22/2024 11:40:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcb5
11/22/2024 11:40:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6911fb139cb87dfcb6
11/22/2024 11:40:00 AM UTC [INFO] Received an event for node: 67406cd411fb139cb87df90d
11/22/2024 11:40:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd411fb139cb87df90d
11/22/2024 11:40:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6c11fb139cb87dfcbc
11/22/2024 11:40:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6c11fb139cb87dfcbd
11/22/2024 11:40:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6c11fb139cb87dfcbe
11/22/2024 11:40:03 AM UTC [INFO] Received an event for node: 67406cc511fb139cb87df8aa
11/22/2024 11:40:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc511fb139cb87df8aa
11/22/2024 11:40:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7111fb139cb87dfcc4
11/22/2024 11:40:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7111fb139cb87dfcc5
11/22/2024 11:40:05 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7111fb139cb87dfcc6
11/22/2024 11:40:06 AM UTC [INFO] Received an event for node: 67406cd611fb139cb87df91f
11/22/2024 11:40:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd611fb139cb87df91f
11/22/2024 11:40:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7211fb139cb87dfccc
11/22/2024 11:40:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7211fb139cb87dfccd
11/22/2024 11:40:08 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7211fb139cb87dfcce
11/22/2024 11:40:08 AM UTC [INFO] Received an event for node: 67406cce11fb139cb87df8e9
11/22/2024 11:40:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cce11fb139cb87df8e9
11/22/2024 11:40:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcd4
11/22/2024 11:40:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcd5
11/22/2024 11:40:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcd6
11/22/2024 11:40:11 AM UTC [INFO] Received an event for node: 67406cd511fb139cb87df913
11/22/2024 11:40:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd511fb139cb87df913
11/22/2024 11:40:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcdc
11/22/2024 11:40:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcdd
11/22/2024 11:40:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7311fb139cb87dfcde
11/22/2024 11:40:14 AM UTC [INFO] Received an event for node: 67406cc411fb139cb87df8a4
11/22/2024 11:40:16 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc411fb139cb87df8a4
11/22/2024 11:40:16 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7411fb139cb87dfce4
11/22/2024 11:40:16 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7411fb139cb87dfce5
11/22/2024 11:40:16 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7411fb139cb87dfce6
11/22/2024 11:40:17 AM UTC [INFO] Received an event for node: 67406cd511fb139cb87df919
11/22/2024 11:40:19 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd511fb139cb87df919
11/22/2024 11:40:19 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7611fb139cb87dfcec
11/22/2024 11:40:19 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7611fb139cb87dfced
11/22/2024 11:40:19 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7611fb139cb87dfcee
11/22/2024 11:40:19 AM UTC [INFO] Received an event for node: 67406cc911fb139cb87df8c2
11/22/2024 11:40:22 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc911fb139cb87df8c2
11/22/2024 11:40:22 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7b11fb139cb87dfcf4
11/22/2024 11:40:22 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7b11fb139cb87dfcf5
11/22/2024 11:40:22 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d7b11fb139cb87dfcf6
11/22/2024 11:40:22 AM UTC [INFO] Received an event for node: 67406cc611fb139cb87df8ad
11/22/2024 11:40:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc611fb139cb87df8ad
11/22/2024 11:40:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8211fb139cb87dfcfc
11/22/2024 11:40:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8211fb139cb87dfcfd
11/22/2024 11:40:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8211fb139cb87dfcfe
11/22/2024 11:40:25 AM UTC [INFO] Received an event for node: 67406cda11fb139cb87df937
11/22/2024 11:40:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cda11fb139cb87df937
11/22/2024 11:40:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8311fb139cb87dfd04
11/22/2024 11:40:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8311fb139cb87dfd05
11/22/2024 11:40:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d8311fb139cb87dfd06
11/22/2024 11:40:28 AM UTC [INFO] Received an event for node: 67406cdf11fb139cb87df95d
11/22/2024 11:40:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdf11fb139cb87df95d
11/22/2024 11:40:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9611fb139cb87dfd0c
11/22/2024 11:40:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9611fb139cb87dfd0d
11/22/2024 11:40:32 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9611fb139cb87dfd0e
11/22/2024 11:40:32 AM UTC [INFO] Received an event for node: 67406ce711fb139cb87df990
11/22/2024 11:40:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce711fb139cb87df990
11/22/2024 11:40:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9a11fb139cb87dfd14
11/22/2024 11:40:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9a11fb139cb87dfd15
11/22/2024 11:40:36 AM UTC [INFO] Received an event for node: 67406ce111fb139cb87df969
11/22/2024 11:40:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce111fb139cb87df969
11/22/2024 11:40:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd1b
11/22/2024 11:40:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd1c
11/22/2024 11:40:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd1d
11/22/2024 11:40:40 AM UTC [INFO] Received an event for node: 67406ce011fb139cb87df960
11/22/2024 11:40:43 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce011fb139cb87df960
11/22/2024 11:40:43 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd23
11/22/2024 11:40:43 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd24
11/22/2024 11:40:43 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d9b11fb139cb87dfd25
11/22/2024 11:40:43 AM UTC [INFO] Received an event for node: 67406d1a11fb139cb87dfaf3
11/22/2024 11:40:45 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1a11fb139cb87dfaf3
11/22/2024 11:40:45 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406da411fb139cb87dfd2b
11/22/2024 11:40:45 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406da411fb139cb87dfd2c
11/22/2024 11:40:45 AM UTC [INFO] Received an event for node: 67406ce411fb139cb87df978
11/22/2024 11:40:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce411fb139cb87df978
11/22/2024 11:40:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db011fb139cb87dfd32
11/22/2024 11:40:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db011fb139cb87dfd33
11/22/2024 11:40:47 AM UTC [INFO] Received an event for node: 67406d1311fb139cb87dfac9
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1311fb139cb87dfac9
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd39
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd3a
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd3b
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd3c
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd3d
11/22/2024 11:40:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db411fb139cb87dfd3e
11/22/2024 11:40:52 AM UTC [INFO] Received an event for node: 67406cda11fb139cb87df93a
11/22/2024 11:40:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cda11fb139cb87df93a
11/22/2024 11:40:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db711fb139cb87dfd44
11/22/2024 11:40:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db711fb139cb87dfd45
11/22/2024 11:40:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406db711fb139cb87dfd46
11/22/2024 11:40:54 AM UTC [INFO] Received an event for node: 67406d1b11fb139cb87dfafc
11/22/2024 11:40:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1b11fb139cb87dfafc
11/22/2024 11:40:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dbf11fb139cb87dfd4c
11/22/2024 11:40:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dbf11fb139cb87dfd4d
11/22/2024 11:40:57 AM UTC [INFO] Received an event for node: 67406d1b11fb139cb87dfaf9
11/22/2024 11:40:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1b11fb139cb87dfaf9
11/22/2024 11:40:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc011fb139cb87dfd53
11/22/2024 11:40:59 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc011fb139cb87dfd54
11/22/2024 11:40:59 AM UTC [INFO] Received an event for node: 67406cea11fb139cb87df9a2
11/22/2024 11:41:01 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cea11fb139cb87df9a2
11/22/2024 11:41:01 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc111fb139cb87dfd5a
11/22/2024 11:41:01 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc111fb139cb87dfd5c
11/22/2024 11:41:01 AM UTC [INFO] Received an event for node: 67406ce711fb139cb87df98d
11/22/2024 11:41:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce711fb139cb87df98d
11/22/2024 11:41:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc111fb139cb87dfd5d
11/22/2024 11:41:03 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc111fb139cb87dfd5f
11/22/2024 11:41:03 AM UTC [INFO] Received an event for node: 67406d1a11fb139cb87dfaf6
11/22/2024 11:41:06 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1a11fb139cb87dfaf6
11/22/2024 11:41:06 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc311fb139cb87dfd68
11/22/2024 11:41:06 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc311fb139cb87dfd69
11/22/2024 11:41:06 AM UTC [INFO] Received an event for node: 67406cd911fb139cb87df92e
11/22/2024 11:41:09 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd911fb139cb87df92e
11/22/2024 11:41:09 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc411fb139cb87dfd6f
11/22/2024 11:41:09 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc411fb139cb87dfd70
11/22/2024 11:41:09 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc411fb139cb87dfd71
11/22/2024 11:41:09 AM UTC [INFO] Received an event for node: 67406d2111fb139cb87dfb08
11/22/2024 11:41:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2111fb139cb87dfb08
11/22/2024 11:41:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb3
11/22/2024 11:41:11 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb4
11/22/2024 11:41:11 AM UTC [INFO] Received an event for node: 67406cf811fb139cb87df9ff
11/22/2024 11:41:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf811fb139cb87df9ff
11/22/2024 11:41:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe4a
11/22/2024 11:41:13 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe4c
11/22/2024 11:41:13 AM UTC [INFO] Received an event for node: 67406d0911fb139cb87dfa7c
11/22/2024 11:43:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0911fb139cb87dfa7c
11/22/2024 11:43:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd80
11/22/2024 11:43:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd81
11/22/2024 11:43:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd82
11/22/2024 11:43:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd83
11/22/2024 11:43:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd84
11/22/2024 11:43:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd85
11/22/2024 11:43:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd86
11/22/2024 11:43:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd87
11/22/2024 11:43:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd88
11/22/2024 11:43:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd89
11/22/2024 11:43:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8a
11/22/2024 11:43:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8b
11/22/2024 11:43:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8c
11/22/2024 11:43:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8d
11/22/2024 11:43:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8e
11/22/2024 11:43:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd8f
11/22/2024 11:43:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd90
11/22/2024 11:43:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd91
11/22/2024 11:43:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd92
11/22/2024 11:43:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd93
11/22/2024 11:43:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd94
11/22/2024 11:43:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd95
11/22/2024 11:43:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd96
11/22/2024 11:43:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd97
11/22/2024 11:43:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd98
11/22/2024 11:43:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd99
11/22/2024 11:43:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9a
11/22/2024 11:43:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9b
11/22/2024 11:43:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9c
11/22/2024 11:43:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9d
11/22/2024 11:43:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9e
11/22/2024 11:43:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfd9f
11/22/2024 11:43:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda0
11/22/2024 11:43:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda1
11/22/2024 11:43:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda2
11/22/2024 11:43:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda3
11/22/2024 11:43:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda4
11/22/2024 11:43:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda5
11/22/2024 11:43:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda6
11/22/2024 11:43:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda7
11/22/2024 11:43:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda8
11/22/2024 11:43:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfda9
11/22/2024 11:43:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdaa
11/22/2024 11:43:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdab
11/22/2024 11:43:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdac
11/22/2024 11:43:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdad
11/22/2024 11:43:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdae
11/22/2024 11:43:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdaf
11/22/2024 11:43:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdb0
11/22/2024 11:43:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdb2
11/22/2024 11:43:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdb5
11/22/2024 11:43:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdb7
11/22/2024 11:43:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdb9
11/22/2024 11:43:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdbb
11/22/2024 11:43:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdbd
11/22/2024 11:43:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdbe
11/22/2024 11:43:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdbf
11/22/2024 11:43:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc0
11/22/2024 11:43:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc1
11/22/2024 11:43:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc2
11/22/2024 11:43:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc3
11/22/2024 11:43:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc4
11/22/2024 11:43:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc5
11/22/2024 11:43:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc6
11/22/2024 11:43:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc7
11/22/2024 11:43:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc8
11/22/2024 11:43:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdc9
11/22/2024 11:43:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdca
11/22/2024 11:43:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdcb
11/22/2024 11:43:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdcc
11/22/2024 11:43:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdcd
11/22/2024 11:43:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdce
11/22/2024 11:43:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdcf
11/22/2024 11:43:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd0
11/22/2024 11:43:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd1
11/22/2024 11:43:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd2
11/22/2024 11:43:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd3
11/22/2024 11:43:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd4
11/22/2024 11:43:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd5
11/22/2024 11:43:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd6
11/22/2024 11:43:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd7
11/22/2024 11:43:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd8
11/22/2024 11:43:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdd9
11/22/2024 11:43:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdda
11/22/2024 11:43:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfddb
11/22/2024 11:43:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfddc
11/22/2024 11:43:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfddd
11/22/2024 11:43:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdde
11/22/2024 11:43:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfddf
11/22/2024 11:43:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde0
11/22/2024 11:43:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde1
11/22/2024 11:43:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde2
11/22/2024 11:43:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde3
11/22/2024 11:43:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde4
11/22/2024 11:43:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde5
11/22/2024 11:43:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde6
11/22/2024 11:43:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde7
11/22/2024 11:43:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde8
11/22/2024 11:43:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfde9
11/22/2024 11:43:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdea
11/22/2024 11:43:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdeb
11/22/2024 11:43:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdec
11/22/2024 11:43:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfded
11/22/2024 11:43:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdee
11/22/2024 11:43:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdef
11/22/2024 11:43:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf0
11/22/2024 11:43:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf1
11/22/2024 11:43:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf2
11/22/2024 11:43:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf3
11/22/2024 11:43:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf4
11/22/2024 11:43:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf5
11/22/2024 11:43:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc611fb139cb87dfdf6
11/22/2024 11:43:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdf7
11/22/2024 11:43:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdf8
11/22/2024 11:43:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdf9
11/22/2024 11:43:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdfa
11/22/2024 11:43:58 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdfb
11/22/2024 11:43:58 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdfc
11/22/2024 11:43:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdfd
11/22/2024 11:43:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdfe
11/22/2024 11:43:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfdff
11/22/2024 11:44:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe00
11/22/2024 11:44:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe01
11/22/2024 11:44:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe02
11/22/2024 11:44:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe03
11/22/2024 11:44:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe04
11/22/2024 11:44:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe05
11/22/2024 11:44:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe06
11/22/2024 11:44:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe07
11/22/2024 11:44:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe08
11/22/2024 11:44:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe09
11/22/2024 11:44:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0a
11/22/2024 11:44:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0b
11/22/2024 11:44:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0c
11/22/2024 11:44:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0d
11/22/2024 11:44:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0e
11/22/2024 11:44:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe0f
11/22/2024 11:44:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe10
11/22/2024 11:44:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe11
11/22/2024 11:44:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe12
11/22/2024 11:44:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe13
11/22/2024 11:44:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe14
11/22/2024 11:44:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe15
11/22/2024 11:44:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe16
11/22/2024 11:44:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe17
11/22/2024 11:44:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe18
11/22/2024 11:44:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe19
11/22/2024 11:44:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1a
11/22/2024 11:44:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1b
11/22/2024 11:44:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1c
11/22/2024 11:44:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1d
11/22/2024 11:44:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1e
11/22/2024 11:44:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe1f
11/22/2024 11:44:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe20
11/22/2024 11:44:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe21
11/22/2024 11:44:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe22
11/22/2024 11:44:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe23
11/22/2024 11:44:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe24
11/22/2024 11:44:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe25
11/22/2024 11:44:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe26
11/22/2024 11:44:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe27
11/22/2024 11:44:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe28
11/22/2024 11:44:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe29
11/22/2024 11:44:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2a
11/22/2024 11:44:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2b
11/22/2024 11:44:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2c
11/22/2024 11:44:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2d
11/22/2024 11:44:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2e
11/22/2024 11:44:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe2f
11/22/2024 11:44:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe30
11/22/2024 11:44:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe31
11/22/2024 11:44:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe32
11/22/2024 11:44:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe33
11/22/2024 11:44:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe34
11/22/2024 11:44:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe35
11/22/2024 11:44:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe36
11/22/2024 11:44:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe37
11/22/2024 11:44:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe38
11/22/2024 11:44:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe39
11/22/2024 11:44:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3a
11/22/2024 11:44:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3b
11/22/2024 11:44:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3c
11/22/2024 11:44:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3d
11/22/2024 11:44:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3e
11/22/2024 11:44:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe3f
11/22/2024 11:44:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe40
11/22/2024 11:44:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe41
11/22/2024 11:44:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe42
11/22/2024 11:44:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe43
11/22/2024 11:44:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe44
11/22/2024 11:44:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe45
11/22/2024 11:44:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe46
11/22/2024 11:44:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe47
11/22/2024 11:44:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe49
11/22/2024 11:44:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe4b
11/22/2024 11:44:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe4d
11/22/2024 11:44:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe4f
11/22/2024 11:44:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe51
11/22/2024 11:44:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe53
11/22/2024 11:44:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe55
11/22/2024 11:44:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe56
11/22/2024 11:44:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe57
11/22/2024 11:44:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe58
11/22/2024 11:44:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe59
11/22/2024 11:44:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5a
11/22/2024 11:44:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5b
11/22/2024 11:44:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5c
11/22/2024 11:44:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5d
11/22/2024 11:44:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5e
11/22/2024 11:44:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe5f
11/22/2024 11:44:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe60
11/22/2024 11:44:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe61
11/22/2024 11:44:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe62
11/22/2024 11:44:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe63
11/22/2024 11:44:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe64
11/22/2024 11:44:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe65
11/22/2024 11:44:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe66
11/22/2024 11:44:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dc711fb139cb87dfe67
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0911fb139cb87dfa7c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd77
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd78
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd79
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd7f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd80
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd81
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd82
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd83
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd84
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd85
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd86
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd87
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd88
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd89
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd8f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd90
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd91
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd92
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd93
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd94
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd95
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd96
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd97
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd98
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd99
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfd9f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda1
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda3
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda4
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda6
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda8
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfda9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdaa
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdab
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdac
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdad
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdae
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdaf
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdb9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdbb
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdbd
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdbe
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdbf
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc1
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc3
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc4
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc6
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc8
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdc9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdca
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdcb
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdcc
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdcd
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdce
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdcf
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd1
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd3
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd4
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd6
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd8
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdd9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdda
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfddb
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfddc
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfddd
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdde
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfddf
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde1
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde3
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde4
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde6
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde8
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfde9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdea
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdeb
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdec
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfded
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdee
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdef
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf0
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf1
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf2
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf3
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf4
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf5
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc611fb139cb87dfdf6
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdf7
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdf8
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdf9
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdfa
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdfb
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdfc
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdfd
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdfe
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfdff
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe00
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe01
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe02
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe03
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe04
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe05
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe06
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe07
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe08
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe09
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe0f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe10
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe11
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe12
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe13
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe14
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe15
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe16
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe17
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe18
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe19
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe1f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe20
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe21
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe22
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe23
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe24
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe25
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe26
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe27
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe28
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe29
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe2f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe30
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe31
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe32
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe33
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe34
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe35
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe36
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe37
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe38
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe39
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe3f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe40
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe41
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe42
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe43
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe44
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe45
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe46
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe47
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe49
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe4b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe4d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe4f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe51
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe53
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe55
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe56
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe57
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe58
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe59
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5a
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5b
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5c
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5d
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5e
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe5f
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe60
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe61
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe62
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe63
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe64
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe65
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe66
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe67
11/22/2024 11:44:30 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dc711fb139cb87dfe68
11/22/2024 11:44:31 AM UTC [INFO] Received an event for node: 67406ce511fb139cb87df981
11/22/2024 11:44:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce511fb139cb87df981
11/22/2024 11:44:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dcb11fb139cb87dfe6e
11/22/2024 11:44:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dcb11fb139cb87dfe6f
11/22/2024 11:44:33 AM UTC [INFO] Received an event for node: 67406cfe11fb139cb87dfa2c
11/22/2024 11:44:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfe11fb139cb87dfa2c
11/22/2024 11:44:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dcc11fb139cb87dfe75
11/22/2024 11:44:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dcc11fb139cb87dfe76
11/22/2024 11:44:35 AM UTC [INFO] Received an event for node: 67406ce211fb139cb87df96c
11/22/2024 11:44:37 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce211fb139cb87df96c
11/22/2024 11:44:37 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd111fb139cb87dfe7c
11/22/2024 11:44:37 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd111fb139cb87dfe7d
11/22/2024 11:44:37 AM UTC [INFO] Received an event for node: 67406cdc11fb139cb87df946
11/22/2024 11:44:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdc11fb139cb87df946
11/22/2024 11:44:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd411fb139cb87dfe83
11/22/2024 11:44:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd411fb139cb87dfe84
11/22/2024 11:44:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd411fb139cb87dfe85
11/22/2024 11:44:40 AM UTC [INFO] Received an event for node: 67406d2711fb139cb87dfb19
11/22/2024 11:44:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2711fb139cb87dfb19
11/22/2024 11:44:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dd611fb139cb87dfe8b
11/22/2024 11:44:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2711fb139cb87dfb19
11/22/2024 11:44:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd611fb139cb87dfe8b
11/22/2024 11:44:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd611fb139cb87dfe8c
11/22/2024 11:44:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd611fb139cb87dfe8d
11/22/2024 11:44:44 AM UTC [INFO] Received an event for node: 67406d2b11fb139cb87dfb36
11/22/2024 11:44:48 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.731867] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.739615] Modules linked in:\n[    4.742680] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.750420] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.759549] EIP: __flush_work+0xb8/0xd0\n[    4.763394] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.782146] EAX: 00000000 EBX: c276ee01 ECX: 00000001 EDX: 00000000\n[    4.788413] ESI: c276eea8 EDI: c2740000 EBP: c23f3be8 ESP: c23f3b80\n[    4.794679] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    4.801467] CR0: 80050033 CR2: 00000000 CR3: 0cb58000 CR4: 003506d0\n[    4.807733] Call Trace:\n[    4.810184]  ? show_regs+0x51/0x58\n[    4.813593]  ? __flush_work+0xb8/0xd0\n[    4.817261]  ? __warn+0x8d/0x1b8\n[    4.820497]  ? __flush_work+0xb8/0xd0\n[    4.824165]  ? __flush_work+0xb8/0xd0\n[    4.827840]  ? report_bug+0x186/0x1b0\n[    4.831512]  ? __flush_work+0xb9/0xd0\n[    4.835179]  ? exc_overflow+0x50/0x50\n[    4.838848]  ? handle_bug+0x56/0x90\n[    4.842341]  ? exc_invalid_op+0x1d/0x70\n[    4.846186]  ? handle_exception+0x14b/0x14b\n[    4.850380]  ? exc_overflow+0x50/0x50\n[    4.854049]  ? __flush_work+0xb8/0xd0\n[    4.857718]  ? exc_overflow+0x50/0x50\n[    4.861386]  ? __flush_work+0xb8/0xd0\n[    4.865061]  cancel_delayed_work_sync+0x88/0x90\n[    4.869598]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    4.874135]  ? amdgpu_device_rreg+0x40/0x64\n[    4.878327]  amdgpu_ring_alloc+0x46/0x5c\n[    4.882256]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    4.887400]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    4.892892]  amdgpu_ring_test_helper+0x20/0x90\n[    4.897342]  vcn_v1_0_hw_init+0x67/0x7c\n[    4.901186]  amdgpu_device_ip_init+0x5c5/0xa74\n[    4.905638]  amdgpu_device_init+0xc4a/0x1458\n[    4.909917]  amdgpu_driver_load_kms+0x19/0x9c\n[    4.914280]  amdgpu_pci_probe+0x153/0x570\n[    4.918294]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    4.923264]  pci_device_probe+0x8c/0x118\n[    4.927195]  ? sysfs_create_link+0x1d/0x38\n[    4.931308]  really_probe+0xc2/0x2ac\n[    4.934889]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    4.939250]  ? pm_runtime_barrier+0x52/0x90\n[    4.943441]  __driver_probe_device+0x7a/0x180\n[    4.947803]  ? lock_release+0x6c/0x140\n[    4.951563]  driver_probe_device+0x23/0x108\n[    4.955755]  __driver_attach+0x97/0x188\n[    4.959596]  ? __device_attach_driver+0x120/0x120\n[    4.964302]  bus_for_each_dev+0x71/0xc0\n[    4.968147]  driver_attach+0x19/0x20\n[    4.971733]  ? __device_attach_driver+0x120/0x120\n[    4.976442]  bus_add_driver+0xc9/0x208\n[    4.980206]  driver_register+0x52/0x10c\n[    4.984047]  __pci_register_driver+0x5f/0x68\n[    4.988321]  ? drm_sched_fence_slab_init+0x80/0x80\n[    4.993116]  amdgpu_init+0x62/0xb0\n[    4.996526]  do_one_initcall+0x63/0x2a4\n[    5.000365]  ? rdinit_setup+0x40/0x40\n[    5.004034]  ? parse_args+0x14b/0x3f4\n[    5.007708]  do_initcalls+0xdc/0x218\n[    5.011290]  ? rdinit_setup+0x40/0x40\n[    5.014961]  kernel_init_freeable+0x16b/0x2bc\n[    5.019324]  ? kernel_init+0x18/0x1f4\n[    5.022991]  ? rest_init+0x1cc/0x1cc\n[    5.026570]  kernel_init+0x18/0x1f4\n[    5.030061]  ? schedule_tail+0x50/0x60\n[    5.033819]  ret_from_fork+0x38/0x44\n[    5.037428]  ? rest_init+0x1cc/0x1cc\n[    5.041015]  ret_from_fork_asm+0x12/0x18\n[    5.044944]  entry_INT80_32+0x108/0x108\n[    5.048790] irq event stamp: 836117\n[    5.052281] hardirqs last  enabled at (836127): [<c940906e>] __up_console_sem+0x52/0x58\n[    5.060286] hardirqs last disabled at (836136): [<c9409055>] __up_console_sem+0x39/0x58\n[    5.068290] softirqs last  enabled at (836094): [<c93835b2>] handle_softirqs+0x2fe/0x41c\n[    5.076377] softirqs last disabled at (836089): [<cac8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.325906] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.333762] Modules linked in:\n[    8.336874] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.346393] Tainted: [W]=WARN\n[    8.349383] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    8.358530] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.365005] EIP: __flush_work+0xb8/0xd0\n[    8.368879] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.387673] EAX: 00000000 EBX: c276ee01 ECX: 00000001 EDX: 00000000\n[    8.393970] ESI: c276eea8 EDI: c299217c EBP: c1937d64 ESP: c1937cfc\n[    8.400264] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.407085] CR0: 80050033 CR2: ffd39000 CR3: 0cb58000 CR4: 003506d0\n[    8.413373] Call Trace:\n[    8.415866]  ? show_regs+0x51/0x58\n[    8.419321]  ? __flush_work+0xb8/0xd0\n[    8.423010]  ? __warn+0x8d/0x1b8\n[    8.426263]  ? __flush_work+0xb8/0xd0\n[    8.429952]  ? __flush_work+0xb8/0xd0\n[    8.433645]  ? report_bug+0x186/0x1b0\n[    8.437342]  ? __flush_work+0xb9/0xd0\n[    8.441034]  ? exc_overflow+0x50/0x50\n[    8.444724]  ? handle_bug+0x56/0x90\n[    8.448268]  ? exc_invalid_op+0x1d/0x70\n[    8.452148]  ? handle_exception+0x14b/0x14b\n[    8.456366]  ? exc_overflow+0x50/0x50\n[    8.460058]  ? __flush_work+0xb8/0xd0\n[    8.463745]  ? exc_overflow+0x50/0x50\n[    8.467434]  ? __flush_work+0xb8/0xd0\n[    8.471137]  cancel_delayed_work_sync+0x88/0x90\n[    8.475695]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.480276]  amdgpu_ring_alloc+0x46/0x5c\n[    8.484249]  amdgpu_ib_schedule+0x14b/0x898\n[    8.488474]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.493039]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.498645]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.503639]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.509076]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.513479]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.519364]  process_one_work+0x1b9/0x6f0\n[    8.523405]  ? process_one_work+0x16c/0x6f0\n[    8.527627]  worker_thread+0x168/0x304\n[    8.531410]  kthread+0xcc/0xf4\n[    8.534488]  ? rescuer_thread+0x33c/0x33c\n[    8.538522]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.543963]  ret_from_fork+0x38/0x44\n[    8.547584]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.553006]  ret_from_fork_asm+0x12/0x18\n[    8.556957]  entry_INT80_32+0x108/0x108\n[    8.560839] irq event stamp: 14587\n[    8.564267] hardirqs last  enabled at (14633): [<c940906e>] __up_console_sem+0x52/0x58\n[    8.572216] hardirqs last disabled at (14680): [<c9409055>] __up_console_sem+0x39/0x58\n[    8.580179] softirqs last  enabled at (14724): [<c93835b2>] handle_softirqs+0x2fe/0x41c\n[    8.588227] softirqs last disabled at (14737): [<cac8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:59a46fe0481e23d681422446e63b1fc951719df0', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e6b12708902225a774ff83e60ddbaae43776a02', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e6b12708902225a774ff83e60ddbaae43776a02', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:44:48 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.731867] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.739615] Modules linked in:\n[    4.742680] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.750420] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.759549] EIP: __flush_work+0xb8/0xd0\n[    4.763394] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.782146] EAX: 00000000 EBX: c276ee01 ECX: 00000001 EDX: 00000000\n[    4.788413] ESI: c276eea8 EDI: c2740000 EBP: c23f3be8 ESP: c23f3b80\n[    4.794679] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    4.801467] CR0: 80050033 CR2: 00000000 CR3: 0cb58000 CR4: 003506d0\n[    4.807733] Call Trace:\n[    4.810184]  ? show_regs+0x51/0x58\n[    4.813593]  ? __flush_work+0xb8/0xd0\n[    4.817261]  ? __warn+0x8d/0x1b8\n[    4.820497]  ? __flush_work+0xb8/0xd0\n[    4.824165]  ? __flush_work+0xb8/0xd0\n[    4.827840]  ? report_bug+0x186/0x1b0\n[    4.831512]  ? __flush_work+0xb9/0xd0\n[    4.835179]  ? exc_overflow+0x50/0x50\n[    4.838848]  ? handle_bug+0x56/0x90\n[    4.842341]  ? exc_invalid_op+0x1d/0x70\n[    4.846186]  ? handle_exception+0x14b/0x14b\n[    4.850380]  ? exc_overflow+0x50/0x50\n[    4.854049]  ? __flush_work+0xb8/0xd0\n[    4.857718]  ? exc_overflow+0x50/0x50\n[    4.861386]  ? __flush_work+0xb8/0xd0\n[    4.865061]  cancel_delayed_work_sync+0x88/0x90\n[    4.869598]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    4.874135]  ? amdgpu_device_rreg+0x40/0x64\n[    4.878327]  amdgpu_ring_alloc+0x46/0x5c\n[    4.882256]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    4.887400]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    4.892892]  amdgpu_ring_test_helper+0x20/0x90\n[    4.897342]  vcn_v1_0_hw_init+0x67/0x7c\n[    4.901186]  amdgpu_device_ip_init+0x5c5/0xa74\n[    4.905638]  amdgpu_device_init+0xc4a/0x1458\n[    4.909917]  amdgpu_driver_load_kms+0x19/0x9c\n[    4.914280]  amdgpu_pci_probe+0x153/0x570\n[    4.918294]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    4.923264]  pci_device_probe+0x8c/0x118\n[    4.927195]  ? sysfs_create_link+0x1d/0x38\n[    4.931308]  really_probe+0xc2/0x2ac\n[    4.934889]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    4.939250]  ? pm_runtime_barrier+0x52/0x90\n[    4.943441]  __driver_probe_device+0x7a/0x180\n[    4.947803]  ? lock_release+0x6c/0x140\n[    4.951563]  driver_probe_device+0x23/0x108\n[    4.955755]  __driver_attach+0x97/0x188\n[    4.959596]  ? __device_attach_driver+0x120/0x120\n[    4.964302]  bus_for_each_dev+0x71/0xc0\n[    4.968147]  driver_attach+0x19/0x20\n[    4.971733]  ? __device_attach_driver+0x120/0x120\n[    4.976442]  bus_add_driver+0xc9/0x208\n[    4.980206]  driver_register+0x52/0x10c\n[    4.984047]  __pci_register_driver+0x5f/0x68\n[    4.988321]  ? drm_sched_fence_slab_init+0x80/0x80\n[    4.993116]  amdgpu_init+0x62/0xb0\n[    4.996526]  do_one_initcall+0x63/0x2a4\n[    5.000365]  ? rdinit_setup+0x40/0x40\n[    5.004034]  ? parse_args+0x14b/0x3f4\n[    5.007708]  do_initcalls+0xdc/0x218\n[    5.011290]  ? rdinit_setup+0x40/0x40\n[    5.014961]  kernel_init_freeable+0x16b/0x2bc\n[    5.019324]  ? kernel_init+0x18/0x1f4\n[    5.022991]  ? rest_init+0x1cc/0x1cc\n[    5.026570]  kernel_init+0x18/0x1f4\n[    5.030061]  ? schedule_tail+0x50/0x60\n[    5.033819]  ret_from_fork+0x38/0x44\n[    5.037428]  ? rest_init+0x1cc/0x1cc\n[    5.041015]  ret_from_fork_asm+0x12/0x18\n[    5.044944]  entry_INT80_32+0x108/0x108\n[    5.048790] irq event stamp: 836117\n[    5.052281] hardirqs last  enabled at (836127): [<c940906e>] __up_console_sem+0x52/0x58\n[    5.060286] hardirqs last disabled at (836136): [<c9409055>] __up_console_sem+0x39/0x58\n[    5.068290] softirqs last  enabled at (836094): [<c93835b2>] handle_softirqs+0x2fe/0x41c\n[    5.076377] softirqs last disabled at (836089): [<cac8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.325906] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.333762] Modules linked in:\n[    8.336874] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.346393] Tainted: [W]=WARN\n[    8.349383] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    8.358530] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.365005] EIP: __flush_work+0xb8/0xd0\n[    8.368879] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.387673] EAX: 00000000 EBX: c276ee01 ECX: 00000001 EDX: 00000000\n[    8.393970] ESI: c276eea8 EDI: c299217c EBP: c1937d64 ESP: c1937cfc\n[    8.400264] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.407085] CR0: 80050033 CR2: ffd39000 CR3: 0cb58000 CR4: 003506d0\n[    8.413373] Call Trace:\n[    8.415866]  ? show_regs+0x51/0x58\n[    8.419321]  ? __flush_work+0xb8/0xd0\n[    8.423010]  ? __warn+0x8d/0x1b8\n[    8.426263]  ? __flush_work+0xb8/0xd0\n[    8.429952]  ? __flush_work+0xb8/0xd0\n[    8.433645]  ? report_bug+0x186/0x1b0\n[    8.437342]  ? __flush_work+0xb9/0xd0\n[    8.441034]  ? exc_overflow+0x50/0x50\n[    8.444724]  ? handle_bug+0x56/0x90\n[    8.448268]  ? exc_invalid_op+0x1d/0x70\n[    8.452148]  ? handle_exception+0x14b/0x14b\n[    8.456366]  ? exc_overflow+0x50/0x50\n[    8.460058]  ? __flush_work+0xb8/0xd0\n[    8.463745]  ? exc_overflow+0x50/0x50\n[    8.467434]  ? __flush_work+0xb8/0xd0\n[    8.471137]  cancel_delayed_work_sync+0x88/0x90\n[    8.475695]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.480276]  amdgpu_ring_alloc+0x46/0x5c\n[    8.484249]  amdgpu_ib_schedule+0x14b/0x898\n[    8.488474]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.493039]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.498645]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.503639]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.509076]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.513479]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.519364]  process_one_work+0x1b9/0x6f0\n[    8.523405]  ? process_one_work+0x16c/0x6f0\n[    8.527627]  worker_thread+0x168/0x304\n[    8.531410]  kthread+0xcc/0xf4\n[    8.534488]  ? rescuer_thread+0x33c/0x33c\n[    8.538522]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.543963]  ret_from_fork+0x38/0x44\n[    8.547584]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.553006]  ret_from_fork_asm+0x12/0x18\n[    8.556957]  entry_INT80_32+0x108/0x108\n[    8.560839] irq event stamp: 14587\n[    8.564267] hardirqs last  enabled at (14633): [<c940906e>] __up_console_sem+0x52/0x58\n[    8.572216] hardirqs last disabled at (14680): [<c9409055>] __up_console_sem+0x39/0x58\n[    8.580179] softirqs last  enabled at (14724): [<c93835b2>] handle_softirqs+0x2fe/0x41c\n[    8.588227] softirqs last disabled at (14737): [<cac8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8180408b1f8047266d49fc15c723cf696d39bbbc', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406dd711fb139cb87dfe93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e91664b1037d11d5a0548b1a10fe7a894b75546b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406dd711fb139cb87dfe93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e91664b1037d11d5a0548b1a10fe7a894b75546b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406dd711fb139cb87dfe93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2b11fb139cb87dfb36
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd711fb139cb87dfe93
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd711fb139cb87dfe94
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd711fb139cb87dfe95
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59a46fe0481e23d681422446e63b1fc951719df0
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e6b12708902225a774ff83e60ddbaae43776a02
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e6b12708902225a774ff83e60ddbaae43776a02
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8180408b1f8047266d49fc15c723cf696d39bbbc
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e91664b1037d11d5a0548b1a10fe7a894b75546b
11/22/2024 11:44:48 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e91664b1037d11d5a0548b1a10fe7a894b75546b
11/22/2024 11:44:48 AM UTC [INFO] Received an event for node: 67406ce211fb139cb87df96f
11/22/2024 11:44:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce211fb139cb87df96f
11/22/2024 11:44:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd711fb139cb87dfe9b
11/22/2024 11:44:50 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dd711fb139cb87dfe9c
11/22/2024 11:44:51 AM UTC [INFO] Received an event for node: 67406cd811fb139cb87df92b
11/22/2024 11:44:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd811fb139cb87df92b
11/22/2024 11:44:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dda11fb139cb87dfea2
11/22/2024 11:44:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dda11fb139cb87dfea3
11/22/2024 11:44:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dda11fb139cb87dfea4
11/22/2024 11:44:53 AM UTC [INFO] Received an event for node: 67406cdd11fb139cb87df949
11/22/2024 11:44:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdd11fb139cb87df949
11/22/2024 11:44:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de711fb139cb87dfeaa
11/22/2024 11:44:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de711fb139cb87dfeab
11/22/2024 11:44:56 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de711fb139cb87dfeac
11/22/2024 11:44:56 AM UTC [INFO] Received an event for node: 67406d2811fb139cb87dfb1f
11/22/2024 11:45:00 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    5.037323] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    5.045076] Modules linked in:\n[    5.048141] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    5.055881] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.065357] EIP: __flush_work+0xb8/0xd0\n[    5.069205] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    5.087952] EAX: 00000000 EBX: c272ee01 ECX: 00000001 EDX: 00000000\n[    5.094218] ESI: c272eea8 EDI: c2700000 EBP: c23f3be8 ESP: c23f3b80\n[    5.100484] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.107273] CR0: 80050033 CR2: 00000000 CR3: 10358000 CR4: 003506d0\n[    5.113539] Call Trace:\n[    5.115990]  ? show_regs+0x51/0x58\n[    5.119398]  ? __flush_work+0xb8/0xd0\n[    5.123066]  ? __warn+0x8d/0x1b8\n[    5.126301]  ? __flush_work+0xb8/0xd0\n[    5.129968]  ? __flush_work+0xb8/0xd0\n[    5.133636]  ? report_bug+0x186/0x1b0\n[    5.137308]  ? __flush_work+0xb9/0xd0\n[    5.140983]  ? exc_overflow+0x50/0x50\n[    5.144653]  ? handle_bug+0x56/0x90\n[    5.148145]  ? exc_invalid_op+0x1d/0x70\n[    5.151987]  ? handle_exception+0x14b/0x14b\n[    5.156181]  ? exc_overflow+0x50/0x50\n[    5.159849]  ? __flush_work+0xb8/0xd0\n[    5.163517]  ? exc_overflow+0x50/0x50\n[    5.167185]  ? __flush_work+0xb8/0xd0\n[    5.170859]  cancel_delayed_work_sync+0x88/0x90\n[    5.175396]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.179933]  ? amdgpu_device_rreg+0x40/0x64\n[    5.184124]  amdgpu_ring_alloc+0x46/0x5c\n[    5.188053]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.193194]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.198684]  amdgpu_ring_test_helper+0x20/0x90\n[    5.203134]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.206975]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.211426]  amdgpu_device_init+0xc4a/0x1458\n[    5.215718]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.220088]  amdgpu_pci_probe+0x153/0x570\n[    5.224102]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.229072]  pci_device_probe+0x8c/0x118\n[    5.233002]  ? sysfs_create_link+0x1d/0x38\n[    5.237107]  really_probe+0xc2/0x2ac\n[    5.240687]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.245055]  ? pm_runtime_barrier+0x52/0x90\n[    5.249246]  __driver_probe_device+0x7a/0x180\n[    5.253606]  ? lock_release+0x6c/0x140\n[    5.257365]  driver_probe_device+0x23/0x108\n[    5.261556]  __driver_attach+0x97/0x188\n[    5.265399]  ? __device_attach_driver+0x120/0x120\n[    5.270106]  bus_for_each_dev+0x71/0xc0\n[    5.273945]  driver_attach+0x19/0x20\n[    5.277523]  ? __device_attach_driver+0x120/0x120\n[    5.282232]  bus_add_driver+0xc9/0x208\n[    5.285988]  driver_register+0x52/0x10c\n[    5.289829]  __pci_register_driver+0x5f/0x68\n[    5.294102]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.298897]  amdgpu_init+0x62/0xb0\n[    5.302305]  do_one_initcall+0x63/0x2a4\n[    5.306149]  ? rdinit_setup+0x40/0x40\n[    5.309817]  ? parse_args+0x14b/0x3f4\n[    5.313490]  do_initcalls+0xdc/0x218\n[    5.317071]  ? rdinit_setup+0x40/0x40\n[    5.320739]  kernel_init_freeable+0x16b/0x2bc\n[    5.325104]  ? kernel_init+0x18/0x1f4\n[    5.328771]  ? rest_init+0x1cc/0x1cc\n[    5.332349]  kernel_init+0x18/0x1f4\n[    5.335844]  ? schedule_tail+0x50/0x60\n[    5.339600]  ret_from_fork+0x38/0x44\n[    5.343179]  ? rest_init+0x1cc/0x1cc\n[    5.346760]  ret_from_fork_asm+0x12/0x18\n[    5.350693]  entry_INT80_32+0x108/0x108\n[    5.354536] irq event stamp: 829381\n[    5.358026] hardirqs last  enabled at (829391): [<ccc0906e>] __up_console_sem+0x52/0x58\n[    5.366028] hardirqs last disabled at (829400): [<ccc09055>] __up_console_sem+0x39/0x58\n[    5.374028] softirqs last  enabled at (829368): [<ccb835b2>] handle_softirqs+0x2fe/0x41c\n[    5.382116] softirqs last disabled at (829351): [<ce48da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.594990] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.602750] Modules linked in:\n[    8.605821] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.615227] Tainted: [W]=WARN\n[    8.618218] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    8.627705] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.634171] EIP: __flush_work+0xb8/0xd0\n[    8.638023] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.656793] EAX: 00000000 EBX: c272ee01 ECX: 00000001 EDX: 00000000\n[    8.663075] ESI: c272eea8 EDI: c311a57c EBP: c1405d64 ESP: c1405cfc\n[    8.669357] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.676153] CR0: 80050033 CR2: ffd39000 CR3: 10358000 CR4: 003506d0\n[    8.682429] Call Trace:\n[    8.684891]  ? show_regs+0x51/0x58\n[    8.688311]  ? __flush_work+0xb8/0xd0\n[    8.691990]  ? __warn+0x8d/0x1b8\n[    8.695237]  ? __flush_work+0xb8/0xd0\n[    8.698914]  ? __flush_work+0xb8/0xd0\n[    8.702592]  ? report_bug+0x186/0x1b0\n[    8.706271]  ? __flush_work+0xb9/0xd0\n[    8.709948]  ? exc_overflow+0x50/0x50\n[    8.713627]  ? handle_bug+0x56/0x90\n[    8.717136]  ? exc_invalid_op+0x1d/0x70\n[    8.720991]  ? handle_exception+0x14b/0x14b\n[    8.725201]  ? exc_overflow+0x50/0x50\n[    8.728877]  ? __flush_work+0xb8/0xd0\n[    8.732554]  ? exc_overflow+0x50/0x50\n[    8.736232]  ? __flush_work+0xb8/0xd0\n[    8.739916]  cancel_delayed_work_sync+0x88/0x90\n[    8.744464]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.749014]  amdgpu_ring_alloc+0x46/0x5c\n[    8.752952]  amdgpu_ib_schedule+0x14b/0x898\n[    8.757159]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.761714]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.767305]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.772285]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.777699]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.782073]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.787921]  process_one_work+0x1b9/0x6f0\n[    8.791954]  ? process_one_work+0x16c/0x6f0\n[    8.796157]  worker_thread+0x168/0x304\n[    8.799921]  kthread+0xcc/0xf4\n[    8.802987]  ? rescuer_thread+0x33c/0x33c\n[    8.807003]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.812407]  ret_from_fork+0x38/0x44\n[    8.815996]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.821401]  ret_from_fork_asm+0x12/0x18\n[    8.825336]  entry_INT80_32+0x108/0x108\n[    8.829186] irq event stamp: 7629\n[    8.832509] hardirqs last  enabled at (7641): [<ccc0906e>] __up_console_sem+0x52/0x58\n[    8.840341] hardirqs last disabled at (7652): [<ccc09055>] __up_console_sem+0x39/0x58\n[    8.848178] softirqs last  enabled at (7666): [<ccb835b2>] handle_softirqs+0x2fe/0x41c\n[    8.856100] softirqs last disabled at (7679): [<ce48da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:19a7cc62322381bc1b58638affcda0b33ff90477', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406d2811fb139cb87dfb1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e9279d89433f18466385f9295d20099b80a4cc8', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2811fb139cb87dfb1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e9279d89433f18466385f9295d20099b80a4cc8', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2811fb139cb87dfb1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:45:00 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    5.037323] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    5.045076] Modules linked in:\n[    5.048141] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    5.055881] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.065357] EIP: __flush_work+0xb8/0xd0\n[    5.069205] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    5.087952] EAX: 00000000 EBX: c272ee01 ECX: 00000001 EDX: 00000000\n[    5.094218] ESI: c272eea8 EDI: c2700000 EBP: c23f3be8 ESP: c23f3b80\n[    5.100484] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.107273] CR0: 80050033 CR2: 00000000 CR3: 10358000 CR4: 003506d0\n[    5.113539] Call Trace:\n[    5.115990]  ? show_regs+0x51/0x58\n[    5.119398]  ? __flush_work+0xb8/0xd0\n[    5.123066]  ? __warn+0x8d/0x1b8\n[    5.126301]  ? __flush_work+0xb8/0xd0\n[    5.129968]  ? __flush_work+0xb8/0xd0\n[    5.133636]  ? report_bug+0x186/0x1b0\n[    5.137308]  ? __flush_work+0xb9/0xd0\n[    5.140983]  ? exc_overflow+0x50/0x50\n[    5.144653]  ? handle_bug+0x56/0x90\n[    5.148145]  ? exc_invalid_op+0x1d/0x70\n[    5.151987]  ? handle_exception+0x14b/0x14b\n[    5.156181]  ? exc_overflow+0x50/0x50\n[    5.159849]  ? __flush_work+0xb8/0xd0\n[    5.163517]  ? exc_overflow+0x50/0x50\n[    5.167185]  ? __flush_work+0xb8/0xd0\n[    5.170859]  cancel_delayed_work_sync+0x88/0x90\n[    5.175396]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.179933]  ? amdgpu_device_rreg+0x40/0x64\n[    5.184124]  amdgpu_ring_alloc+0x46/0x5c\n[    5.188053]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.193194]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.198684]  amdgpu_ring_test_helper+0x20/0x90\n[    5.203134]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.206975]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.211426]  amdgpu_device_init+0xc4a/0x1458\n[    5.215718]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.220088]  amdgpu_pci_probe+0x153/0x570\n[    5.224102]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.229072]  pci_device_probe+0x8c/0x118\n[    5.233002]  ? sysfs_create_link+0x1d/0x38\n[    5.237107]  really_probe+0xc2/0x2ac\n[    5.240687]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.245055]  ? pm_runtime_barrier+0x52/0x90\n[    5.249246]  __driver_probe_device+0x7a/0x180\n[    5.253606]  ? lock_release+0x6c/0x140\n[    5.257365]  driver_probe_device+0x23/0x108\n[    5.261556]  __driver_attach+0x97/0x188\n[    5.265399]  ? __device_attach_driver+0x120/0x120\n[    5.270106]  bus_for_each_dev+0x71/0xc0\n[    5.273945]  driver_attach+0x19/0x20\n[    5.277523]  ? __device_attach_driver+0x120/0x120\n[    5.282232]  bus_add_driver+0xc9/0x208\n[    5.285988]  driver_register+0x52/0x10c\n[    5.289829]  __pci_register_driver+0x5f/0x68\n[    5.294102]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.298897]  amdgpu_init+0x62/0xb0\n[    5.302305]  do_one_initcall+0x63/0x2a4\n[    5.306149]  ? rdinit_setup+0x40/0x40\n[    5.309817]  ? parse_args+0x14b/0x3f4\n[    5.313490]  do_initcalls+0xdc/0x218\n[    5.317071]  ? rdinit_setup+0x40/0x40\n[    5.320739]  kernel_init_freeable+0x16b/0x2bc\n[    5.325104]  ? kernel_init+0x18/0x1f4\n[    5.328771]  ? rest_init+0x1cc/0x1cc\n[    5.332349]  kernel_init+0x18/0x1f4\n[    5.335844]  ? schedule_tail+0x50/0x60\n[    5.339600]  ret_from_fork+0x38/0x44\n[    5.343179]  ? rest_init+0x1cc/0x1cc\n[    5.346760]  ret_from_fork_asm+0x12/0x18\n[    5.350693]  entry_INT80_32+0x108/0x108\n[    5.354536] irq event stamp: 829381\n[    5.358026] hardirqs last  enabled at (829391): [<ccc0906e>] __up_console_sem+0x52/0x58\n[    5.366028] hardirqs last disabled at (829400): [<ccc09055>] __up_console_sem+0x39/0x58\n[    5.374028] softirqs last  enabled at (829368): [<ccb835b2>] handle_softirqs+0x2fe/0x41c\n[    5.382116] softirqs last disabled at (829351): [<ce48da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.594990] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.602750] Modules linked in:\n[    8.605821] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.615227] Tainted: [W]=WARN\n[    8.618218] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    8.627705] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.634171] EIP: __flush_work+0xb8/0xd0\n[    8.638023] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.656793] EAX: 00000000 EBX: c272ee01 ECX: 00000001 EDX: 00000000\n[    8.663075] ESI: c272eea8 EDI: c311a57c EBP: c1405d64 ESP: c1405cfc\n[    8.669357] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.676153] CR0: 80050033 CR2: ffd39000 CR3: 10358000 CR4: 003506d0\n[    8.682429] Call Trace:\n[    8.684891]  ? show_regs+0x51/0x58\n[    8.688311]  ? __flush_work+0xb8/0xd0\n[    8.691990]  ? __warn+0x8d/0x1b8\n[    8.695237]  ? __flush_work+0xb8/0xd0\n[    8.698914]  ? __flush_work+0xb8/0xd0\n[    8.702592]  ? report_bug+0x186/0x1b0\n[    8.706271]  ? __flush_work+0xb9/0xd0\n[    8.709948]  ? exc_overflow+0x50/0x50\n[    8.713627]  ? handle_bug+0x56/0x90\n[    8.717136]  ? exc_invalid_op+0x1d/0x70\n[    8.720991]  ? handle_exception+0x14b/0x14b\n[    8.725201]  ? exc_overflow+0x50/0x50\n[    8.728877]  ? __flush_work+0xb8/0xd0\n[    8.732554]  ? exc_overflow+0x50/0x50\n[    8.736232]  ? __flush_work+0xb8/0xd0\n[    8.739916]  cancel_delayed_work_sync+0x88/0x90\n[    8.744464]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.749014]  amdgpu_ring_alloc+0x46/0x5c\n[    8.752952]  amdgpu_ib_schedule+0x14b/0x898\n[    8.757159]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.761714]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.767305]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.772285]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.777699]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.782073]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.787921]  process_one_work+0x1b9/0x6f0\n[    8.791954]  ? process_one_work+0x16c/0x6f0\n[    8.796157]  worker_thread+0x168/0x304\n[    8.799921]  kthread+0xcc/0xf4\n[    8.802987]  ? rescuer_thread+0x33c/0x33c\n[    8.807003]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.812407]  ret_from_fork+0x38/0x44\n[    8.815996]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.821401]  ret_from_fork_asm+0x12/0x18\n[    8.825336]  entry_INT80_32+0x108/0x108\n[    8.829186] irq event stamp: 7629\n[    8.832509] hardirqs last  enabled at (7641): [<ccc0906e>] __up_console_sem+0x52/0x58\n[    8.840341] hardirqs last disabled at (7652): [<ccc09055>] __up_console_sem+0x39/0x58\n[    8.848178] softirqs last  enabled at (7666): [<ccb835b2>] handle_softirqs+0x2fe/0x41c\n[    8.856100] softirqs last disabled at (7679): [<ce48da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aeb57e55d163d77f072089a1cb0009f93ec5037f', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406de811fb139cb87dfeb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c0a2a5ed34a91894661a91e3cb1851568cc42eb', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406de811fb139cb87dfeb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c0a2a5ed34a91894661a91e3cb1851568cc42eb', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406de811fb139cb87dfeb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2811fb139cb87dfb1f
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de811fb139cb87dfeb2
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de811fb139cb87dfeb3
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de811fb139cb87dfeb4
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19a7cc62322381bc1b58638affcda0b33ff90477
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e9279d89433f18466385f9295d20099b80a4cc8
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e9279d89433f18466385f9295d20099b80a4cc8
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aeb57e55d163d77f072089a1cb0009f93ec5037f
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c0a2a5ed34a91894661a91e3cb1851568cc42eb
11/22/2024 11:45:00 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c0a2a5ed34a91894661a91e3cb1851568cc42eb
11/22/2024 11:45:00 AM UTC [INFO] Received an event for node: 67406cc411fb139cb87df8a1
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cc411fb139cb87df8a1
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfeba
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfebb
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfebc
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfebd
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfebe
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfebf
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec0
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec1
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec2
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec3
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec4
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec5
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec6
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec7
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec8
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfec9
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfeca
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfecb
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfecc
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfecd
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfece
11/22/2024 11:45:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406de911fb139cb87dfecf
11/22/2024 11:45:12 AM UTC [INFO] Received an event for node: 67406cde11fb139cb87df957
11/22/2024 11:45:15 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cde11fb139cb87df957
11/22/2024 11:45:15 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dec11fb139cb87dfed5
11/22/2024 11:45:15 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dec11fb139cb87dfed6
11/22/2024 11:45:15 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dec11fb139cb87dfed7
11/22/2024 11:45:15 AM UTC [INFO] Received an event for node: 67406cee11fb139cb87df9c0
11/22/2024 11:45:18 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cee11fb139cb87df9c0
11/22/2024 11:45:18 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ded11fb139cb87dfedd
11/22/2024 11:45:18 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ded11fb139cb87dfede
11/22/2024 11:45:18 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ded11fb139cb87dfedf
11/22/2024 11:45:18 AM UTC [INFO] Received an event for node: 674068ef11fb139cb87df6ac
11/22/2024 11:45:18 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068ef11fb139cb87df6ac
11/22/2024 11:45:19 AM UTC [INFO] Received an event for node: 67406d2811fb139cb87dfb1c
11/22/2024 11:45:21 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2811fb139cb87dfb1c
11/22/2024 11:45:21 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406def11fb139cb87dfeef
11/22/2024 11:45:21 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406def11fb139cb87dfef0
11/22/2024 11:45:21 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406def11fb139cb87dfef1
11/22/2024 11:45:22 AM UTC [INFO] Received an event for node: 67406cdc11fb139cb87df943
11/22/2024 11:45:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdc11fb139cb87df943
11/22/2024 11:45:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dfefb
11/22/2024 11:45:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dfefc
11/22/2024 11:45:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dfefd
11/22/2024 11:45:25 AM UTC [INFO] Received an event for node: 67406cff11fb139cb87dfa32
11/22/2024 11:46:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406cff11fb139cb87dfa32
11/22/2024 11:46:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5b
11/22/2024 11:46:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5d
11/22/2024 11:46:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cff11fb139cb87dfa32
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff11
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff12
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff13
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff14
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff15
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff16
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff17
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff18
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff19
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff1f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff20
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff21
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff22
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff23
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff24
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff25
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff26
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff27
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff28
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff29
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff2f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff30
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff31
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff32
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff33
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff34
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff35
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff36
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff37
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff38
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff39
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff3f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff40
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff41
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff42
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff43
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff44
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff45
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff46
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff47
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff48
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff49
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff4a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff4c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff4d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff4e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff4f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff50
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff51
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff52
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff53
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff54
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff55
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff56
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff57
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff58
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff59
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff62
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff63
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff64
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff65
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff66
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff67
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff68
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff69
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff6f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff70
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff71
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff72
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff73
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff74
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff75
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff76
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff77
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff78
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff79
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff7f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff80
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff81
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff82
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff83
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff84
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff85
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff86
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff87
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff88
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff89
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8a
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8b
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8c
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8d
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8e
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff8f
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff90
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff91
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff92
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff93
11/22/2024 11:46:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff94
11/22/2024 11:46:29 AM UTC [INFO] Received an event for node: 67406ce311fb139cb87df975
11/22/2024 11:46:31 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce311fb139cb87df975
11/22/2024 11:46:31 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df411fb139cb87dffa6
11/22/2024 11:46:31 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df411fb139cb87dffa7
11/22/2024 11:46:32 AM UTC [INFO] Received an event for node: 67406d2911fb139cb87dfb22
11/22/2024 11:46:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2911fb139cb87dfb22
11/22/2024 11:46:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dfa11fb139cb87dffbd
11/22/2024 11:46:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dfa11fb139cb87dffbe
11/22/2024 11:46:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dfa11fb139cb87dffbf
11/22/2024 11:46:35 AM UTC [INFO] Received an event for node: 67406d0211fb139cb87dfa49
11/22/2024 11:47:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0211fb139cb87dfa49
11/22/2024 11:47:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e000e
11/22/2024 11:47:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e0010
11/22/2024 11:47:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e0011
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0211fb139cb87dfa49
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc5
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc6
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc7
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc8
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc9
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffca
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffcb
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffcc
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffcd
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffce
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffcf
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd0
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd1
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd2
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd3
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd4
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd5
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd6
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd7
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd8
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffd9
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffda
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffdb
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffdc
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffdd
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffde
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffdf
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe0
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe1
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe2
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe3
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe4
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe5
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe6
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe7
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe8
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffe9
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffea
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffeb
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffec
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffed
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffee
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffef
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff0
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff1
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff2
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff3
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff4
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff5
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff6
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff7
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff8
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfff9
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfffa
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfffb
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfffc
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfffd
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dfffe
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffff
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0000
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0001
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0002
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0003
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0004
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0005
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0006
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0007
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0008
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0009
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000a
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000b
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000c
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000d
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000e
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000f
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0010
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0011
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0012
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0013
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0014
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0015
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0016
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0017
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0018
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0019
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001a
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001b
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001c
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001d
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001e
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e001f
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0020
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0021
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0022
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0023
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0024
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0025
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0026
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0027
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0028
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0029
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002a
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002b
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002c
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002d
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002e
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e002f
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0030
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0031
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0032
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0033
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0034
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0035
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0036
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0037
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0038
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0039
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003a
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003b
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003c
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003d
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003e
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e003f
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0040
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0041
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0042
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0043
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0044
11/22/2024 11:47:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0045
11/22/2024 11:47:37 AM UTC [INFO] Received an event for node: 67406ce811fb139cb87df993
11/22/2024 11:47:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce811fb139cb87df993
11/22/2024 11:47:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0111fb139cb87e004b
11/22/2024 11:47:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0111fb139cb87e004c
11/22/2024 11:47:40 AM UTC [INFO] Received an event for node: 67406cfb11fb139cb87dfa14
11/22/2024 11:47:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfb11fb139cb87dfa14
11/22/2024 11:47:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0052
11/22/2024 11:47:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0053
11/22/2024 11:47:42 AM UTC [INFO] Received an event for node: 67406cfc11fb139cb87dfa1d
11/22/2024 11:47:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfc11fb139cb87dfa1d
11/22/2024 11:47:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0059
11/22/2024 11:47:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e005a
11/22/2024 11:47:44 AM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa55
11/22/2024 11:48:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa55
11/22/2024 11:48:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00a9
11/22/2024 11:48:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00ab
11/22/2024 11:48:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00ac
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa55
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0060
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0061
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0062
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0063
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0064
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0065
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0066
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0067
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0068
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0069
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006a
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006b
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006c
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006d
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006e
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e006f
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e0070
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0071
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0072
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0073
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0074
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0075
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0076
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0077
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0078
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0079
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007a
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007b
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007c
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007d
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007e
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e007f
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0080
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0081
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0082
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0083
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0084
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0085
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0086
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0087
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0088
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0089
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008a
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008b
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008c
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008d
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008e
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e008f
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0090
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0091
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0092
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0093
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0094
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0095
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0096
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0097
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0098
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e0099
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009a
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009b
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009c
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009d
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009e
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e009f
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a0
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a1
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a2
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a3
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a4
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a5
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a6
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a7
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a8
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a9
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00aa
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ab
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ac
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ad
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ae
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00af
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b0
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b1
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b2
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b3
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b4
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b5
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b6
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b7
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b8
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00b9
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ba
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00bb
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00bc
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00bd
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00be
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00bf
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c0
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c1
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c2
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c3
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c4
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c5
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c6
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c7
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c8
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00c9
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ca
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00cb
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00cc
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00cd
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ce
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00cf
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d0
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d1
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d2
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d3
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d4
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d5
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d6
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d7
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d8
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00d9
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00da
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00db
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00dc
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00dd
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00de
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00df
11/22/2024 11:48:41 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00e0
11/22/2024 11:48:41 AM UTC [INFO] Received an event for node: 67406ce411fb139cb87df97b
11/22/2024 11:48:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce411fb139cb87df97b
11/22/2024 11:48:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00e6
11/22/2024 11:48:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00e7
11/22/2024 11:48:44 AM UTC [INFO] Received an event for node: 67406ce111fb139cb87df966
11/22/2024 11:48:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce111fb139cb87df966
11/22/2024 11:48:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00ed
11/22/2024 11:48:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00ee
11/22/2024 11:48:46 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00ef
11/22/2024 11:48:46 AM UTC [INFO] Received an event for node: 67406d5011fb139cb87dfc1e
11/22/2024 11:48:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5011fb139cb87dfc1e
11/22/2024 11:48:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00f5
11/22/2024 11:48:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00f6
11/22/2024 11:48:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0b11fb139cb87e00f7
11/22/2024 11:48:49 AM UTC [INFO] Received an event for node: 67406cf611fb139cb87df9f6
11/22/2024 11:48:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf611fb139cb87df9f6
11/22/2024 11:48:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0e11fb139cb87e00fd
11/22/2024 11:48:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0e11fb139cb87e00fe
11/22/2024 11:48:51 AM UTC [INFO] Received an event for node: 67406cfd11fb139cb87dfa23
11/22/2024 11:48:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfd11fb139cb87dfa23
11/22/2024 11:48:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1111fb139cb87e0104
11/22/2024 11:48:53 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1111fb139cb87e0105
11/22/2024 11:48:53 AM UTC [INFO] Received an event for node: 67406ce911fb139cb87df99f
11/22/2024 11:48:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce911fb139cb87df99f
11/22/2024 11:48:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e010b
11/22/2024 11:48:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e010c
11/22/2024 11:48:55 AM UTC [INFO] Received an event for node: 674068e111fb139cb87df66a
11/22/2024 11:48:56 AM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e111fb139cb87df66a
11/22/2024 11:48:56 AM UTC [INFO] Received an event for node: 67406cfa11fb139cb87dfa11
11/22/2024 11:48:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfa11fb139cb87dfa11
11/22/2024 11:48:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e018d
11/22/2024 11:48:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e018f
11/22/2024 11:48:58 AM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa5b
11/22/2024 11:49:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa5b
11/22/2024 11:49:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e015d
11/22/2024 11:49:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e015f
11/22/2024 11:49:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e0160
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa5b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0112
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0113
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0114
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0115
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0116
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0117
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0118
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0119
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e011f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0120
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0121
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0122
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0123
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0124
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0125
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0126
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0127
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0128
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0129
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e012f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0130
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0131
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0132
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0133
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0134
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0135
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0136
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0137
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0138
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0139
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e013f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0140
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0141
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0142
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0143
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0144
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0145
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0146
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0147
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0148
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0149
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e014f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0150
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0151
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0154
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0155
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0156
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0157
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0158
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0159
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0160
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0161
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0162
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0163
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0164
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0165
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0166
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0167
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0168
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0169
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e016b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e016c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e016d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e016f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0170
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0171
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0172
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0173
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0174
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0175
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0176
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0177
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0178
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0179
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017d
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e017f
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0180
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0181
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0182
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0183
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0184
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0185
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0186
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0187
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0188
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0189
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e018a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e018c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e018e
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0190
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0192
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0194
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0196
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0198
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0199
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e019a
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e019b
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e019c
11/22/2024 11:49:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e019d
11/22/2024 11:49:58 AM UTC [INFO] Received an event for node: 67406cdb11fb139cb87df93d
11/22/2024 11:50:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdb11fb139cb87df93d
11/22/2024 11:50:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1a11fb139cb87e01a9
11/22/2024 11:50:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1a11fb139cb87e01aa
11/22/2024 11:50:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1a11fb139cb87e01ab
11/22/2024 11:50:01 AM UTC [INFO] Received an event for node: 67406e1b11fb139cb87e01b4
11/22/2024 11:50:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:50:01 AM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 11:50:01 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1b11fb139cb87e01b4
11/22/2024 11:50:01 AM UTC [INFO] Received an event for node: 67406d0a11fb139cb87dfa7f
11/22/2024 11:52:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0a11fb139cb87dfa7f
11/22/2024 11:52:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01c6
11/22/2024 11:52:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01c7
11/22/2024 11:52:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01c8
11/22/2024 11:52:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01c9
11/22/2024 11:52:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ca
11/22/2024 11:52:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01cb
11/22/2024 11:52:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01cc
11/22/2024 11:52:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01cd
11/22/2024 11:52:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ce
11/22/2024 11:52:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01cf
11/22/2024 11:52:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d0
11/22/2024 11:52:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d1
11/22/2024 11:52:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d2
11/22/2024 11:52:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d3
11/22/2024 11:52:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d4
11/22/2024 11:52:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d5
11/22/2024 11:52:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d6
11/22/2024 11:52:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d7
11/22/2024 11:52:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d8
11/22/2024 11:52:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01d9
11/22/2024 11:52:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01da
11/22/2024 11:52:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01db
11/22/2024 11:52:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01dc
11/22/2024 11:52:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01dd
11/22/2024 11:52:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01de
11/22/2024 11:52:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01df
11/22/2024 11:52:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e0
11/22/2024 11:52:13 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e1
11/22/2024 11:52:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e2
11/22/2024 11:52:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e3
11/22/2024 11:52:14 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e4
11/22/2024 11:52:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e5
11/22/2024 11:52:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e6
11/22/2024 11:52:15 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e7
11/22/2024 11:52:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e8
11/22/2024 11:52:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01e9
11/22/2024 11:52:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ea
11/22/2024 11:52:16 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01eb
11/22/2024 11:52:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ec
11/22/2024 11:52:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ed
11/22/2024 11:52:17 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ee
11/22/2024 11:52:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ef
11/22/2024 11:52:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f0
11/22/2024 11:52:18 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f1
11/22/2024 11:52:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f2
11/22/2024 11:52:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f3
11/22/2024 11:52:19 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f4
11/22/2024 11:52:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f5
11/22/2024 11:52:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f6
11/22/2024 11:52:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f7
11/22/2024 11:52:20 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f8
11/22/2024 11:52:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01f9
11/22/2024 11:52:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01fa
11/22/2024 11:52:21 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01fb
11/22/2024 11:52:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01fc
11/22/2024 11:52:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01fd
11/22/2024 11:52:22 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01fe
11/22/2024 11:52:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e01ff
11/22/2024 11:52:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0200
11/22/2024 11:52:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0201
11/22/2024 11:52:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0202
11/22/2024 11:52:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0203
11/22/2024 11:52:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0204
11/22/2024 11:52:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0205
11/22/2024 11:52:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0206
11/22/2024 11:52:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0207
11/22/2024 11:52:25 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0208
11/22/2024 11:52:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0209
11/22/2024 11:52:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020a
11/22/2024 11:52:26 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020b
11/22/2024 11:52:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020c
11/22/2024 11:52:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020d
11/22/2024 11:52:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020e
11/22/2024 11:52:27 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e020f
11/22/2024 11:52:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0210
11/22/2024 11:52:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0211
11/22/2024 11:52:28 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0212
11/22/2024 11:52:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0213
11/22/2024 11:52:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0214
11/22/2024 11:52:29 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0215
11/22/2024 11:52:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0216
11/22/2024 11:52:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0217
11/22/2024 11:52:30 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0218
11/22/2024 11:52:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0219
11/22/2024 11:52:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021a
11/22/2024 11:52:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021b
11/22/2024 11:52:31 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021c
11/22/2024 11:52:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021d
11/22/2024 11:52:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021e
11/22/2024 11:52:32 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e021f
11/22/2024 11:52:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0220
11/22/2024 11:52:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0221
11/22/2024 11:52:33 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0222
11/22/2024 11:52:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0223
11/22/2024 11:52:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0224
11/22/2024 11:52:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0225
11/22/2024 11:52:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0226
11/22/2024 11:52:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0227
11/22/2024 11:52:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0228
11/22/2024 11:52:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0229
11/22/2024 11:52:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022a
11/22/2024 11:52:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022b
11/22/2024 11:52:36 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022c
11/22/2024 11:52:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022d
11/22/2024 11:52:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022e
11/22/2024 11:52:37 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e022f
11/22/2024 11:52:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0230
11/22/2024 11:52:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0231
11/22/2024 11:52:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0232
11/22/2024 11:52:38 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0233
11/22/2024 11:52:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0234
11/22/2024 11:52:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0235
11/22/2024 11:52:39 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0236
11/22/2024 11:52:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0237
11/22/2024 11:52:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0238
11/22/2024 11:52:40 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0239
11/22/2024 11:52:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023a
11/22/2024 11:52:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023b
11/22/2024 11:52:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023c
11/22/2024 11:52:41 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023d
11/22/2024 11:52:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023e
11/22/2024 11:52:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e023f
11/22/2024 11:52:42 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0240
11/22/2024 11:52:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0241
11/22/2024 11:52:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0242
11/22/2024 11:52:43 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0243
11/22/2024 11:52:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0244
11/22/2024 11:52:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0245
11/22/2024 11:52:44 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0246
11/22/2024 11:52:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0247
11/22/2024 11:52:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0248
11/22/2024 11:52:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0249
11/22/2024 11:52:45 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024a
11/22/2024 11:52:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024b
11/22/2024 11:52:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024c
11/22/2024 11:52:46 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024d
11/22/2024 11:52:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024e
11/22/2024 11:52:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e024f
11/22/2024 11:52:47 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0250
11/22/2024 11:52:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0251
11/22/2024 11:52:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0252
11/22/2024 11:52:48 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0253
11/22/2024 11:52:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0254
11/22/2024 11:52:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0255
11/22/2024 11:52:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0256
11/22/2024 11:52:49 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0257
11/22/2024 11:52:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0258
11/22/2024 11:52:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0259
11/22/2024 11:52:50 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025a
11/22/2024 11:52:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025b
11/22/2024 11:52:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025c
11/22/2024 11:52:51 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025d
11/22/2024 11:52:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025e
11/22/2024 11:52:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e025f
11/22/2024 11:52:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0260
11/22/2024 11:52:52 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0261
11/22/2024 11:52:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0262
11/22/2024 11:52:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0263
11/22/2024 11:52:53 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0264
11/22/2024 11:52:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0265
11/22/2024 11:52:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0266
11/22/2024 11:52:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0267
11/22/2024 11:52:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0268
11/22/2024 11:52:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0269
11/22/2024 11:52:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026a
11/22/2024 11:52:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026b
11/22/2024 11:52:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026c
11/22/2024 11:52:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026d
11/22/2024 11:52:56 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026e
11/22/2024 11:52:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e026f
11/22/2024 11:52:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0270
11/22/2024 11:52:57 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0271
11/22/2024 11:52:58 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0272
11/22/2024 11:52:58 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0273
11/22/2024 11:52:58 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0274
11/22/2024 11:52:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0275
11/22/2024 11:52:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0276
11/22/2024 11:52:59 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0277
11/22/2024 11:53:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0278
11/22/2024 11:53:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0279
11/22/2024 11:53:00 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027a
11/22/2024 11:53:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027b
11/22/2024 11:53:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027c
11/22/2024 11:53:01 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027d
11/22/2024 11:53:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027e
11/22/2024 11:53:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e027f
11/22/2024 11:53:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0280
11/22/2024 11:53:02 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0281
11/22/2024 11:53:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0282
11/22/2024 11:53:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0283
11/22/2024 11:53:03 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0284
11/22/2024 11:53:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0285
11/22/2024 11:53:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0286
11/22/2024 11:53:04 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0287
11/22/2024 11:53:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0288
11/22/2024 11:53:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0289
11/22/2024 11:53:05 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028a
11/22/2024 11:53:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028b
11/22/2024 11:53:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028c
11/22/2024 11:53:06 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028d
11/22/2024 11:53:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028e
11/22/2024 11:53:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e028f
11/22/2024 11:53:07 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0290
11/22/2024 11:53:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0291
11/22/2024 11:53:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0292
11/22/2024 11:53:08 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0293
11/22/2024 11:53:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0294
11/22/2024 11:53:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0295
11/22/2024 11:53:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0296
11/22/2024 11:53:09 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0297
11/22/2024 11:53:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0298
11/22/2024 11:53:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e0299
11/22/2024 11:53:10 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029a
11/22/2024 11:53:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029b
11/22/2024 11:53:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029c
11/22/2024 11:53:11 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029d
11/22/2024 11:53:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029e
11/22/2024 11:53:12 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1f11fb139cb87e029f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0a11fb139cb87dfa7f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01bd
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01be
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01bf
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c0
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c1
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c2
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c3
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c4
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c5
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c6
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c7
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c8
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01c9
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ca
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01cb
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01cc
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01cd
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ce
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01cf
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d0
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d1
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d2
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d3
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d4
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d5
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d6
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d7
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d8
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01d9
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01da
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01db
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01dc
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01dd
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01de
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01df
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e0
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e1
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e2
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e3
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e4
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e5
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e6
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e7
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e8
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01e9
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ea
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01eb
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ec
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ed
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ee
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ef
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f0
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f1
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f2
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f3
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f4
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f5
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f6
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f7
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f8
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01f9
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01fa
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01fb
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01fc
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01fd
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01fe
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e01ff
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0200
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0201
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0202
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0203
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0204
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0205
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0206
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0207
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0208
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0209
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e020f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0210
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0211
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0212
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0213
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0214
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0215
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0216
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0217
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0218
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0219
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e021f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0220
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0221
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0222
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0223
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0224
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0225
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0226
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0227
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0228
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0229
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e022f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0230
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0231
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0232
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0233
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0234
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0235
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0236
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0237
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0238
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0239
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e023f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0240
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0241
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0242
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0243
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0244
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0245
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0246
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0247
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0248
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0249
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e024f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0250
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0251
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0252
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0253
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0254
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0255
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0256
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0257
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0258
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0259
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e025f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0260
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0261
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0262
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0263
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0264
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0265
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0266
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0267
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0268
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0269
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e026f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0270
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0271
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0272
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0273
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0274
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0275
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0276
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0277
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0278
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0279
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e027f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0280
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0281
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0282
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0283
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0284
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0285
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0286
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0287
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0288
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0289
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e028f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0290
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0291
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0292
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0293
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0294
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0295
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0296
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0297
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0298
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e0299
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029a
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029b
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029c
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029d
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029e
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e029f
11/22/2024 11:53:12 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e02a0
11/22/2024 11:53:13 AM UTC [INFO] Received an event for node: 67406cf811fb139cb87dfa05
11/22/2024 11:53:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf811fb139cb87dfa05
11/22/2024 11:53:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02b0
11/22/2024 11:53:14 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02b1
11/22/2024 11:53:14 AM UTC [INFO] Received an event for node: 67406cd911fb139cb87df931
11/22/2024 11:53:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd911fb139cb87df931
11/22/2024 11:53:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02b7
11/22/2024 11:53:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02b8
11/22/2024 11:53:17 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02b9
11/22/2024 11:53:17 AM UTC [INFO] Received an event for node: 67406cdf11fb139cb87df95a
11/22/2024 11:53:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdf11fb139cb87df95a
11/22/2024 11:53:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02bf
11/22/2024 11:53:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02c0
11/22/2024 11:53:20 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2311fb139cb87e02c1
11/22/2024 11:53:21 AM UTC [INFO] Received an event for node: 67406cf711fb139cb87df9f9
11/22/2024 11:53:23 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf711fb139cb87df9f9
11/22/2024 11:53:23 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2511fb139cb87e02c7
11/22/2024 11:53:23 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2511fb139cb87e02c8
11/22/2024 11:53:23 AM UTC [INFO] Received an event for node: 67406cf611fb139cb87df9f3
11/22/2024 11:53:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf611fb139cb87df9f3
11/22/2024 11:53:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0318
11/22/2024 11:53:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031a
11/22/2024 11:53:25 AM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa43
11/22/2024 11:54:23 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa43
11/22/2024 11:54:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e0319
11/22/2024 11:54:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e031d
11/22/2024 11:54:24 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e031f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa43
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ce
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02cf
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d0
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d1
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d2
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d3
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d4
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d5
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d6
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d7
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d8
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02d9
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02da
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02db
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02dc
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02dd
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02de
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02df
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e0
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e1
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e2
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e3
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e4
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e5
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e6
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e7
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e8
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02e9
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ea
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02eb
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ec
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ed
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ee
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ef
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f0
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f1
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f2
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f3
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f4
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f5
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f6
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f7
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f8
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02f9
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02fa
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02fb
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02fc
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02fd
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02fe
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02ff
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0300
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0301
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0302
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0303
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0304
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0305
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0306
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0307
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0308
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0309
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030a
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030b
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030c
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030d
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030e
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e030f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0310
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0311
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0312
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0313
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0314
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0315
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0317
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0319
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031b
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031d
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0321
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0322
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0324
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0325
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0326
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0327
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0328
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0329
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032a
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032b
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032c
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032d
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032e
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e032f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0330
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0331
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0332
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0333
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0334
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0335
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0336
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0337
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0338
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0339
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033a
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033b
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033c
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033d
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033e
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e033f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0340
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0341
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0342
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0343
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0344
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0345
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0346
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0347
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0348
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0349
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034a
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034b
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034c
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034d
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034e
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e034f
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0350
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0351
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0352
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0353
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0354
11/22/2024 11:54:24 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0355
11/22/2024 11:54:25 AM UTC [INFO] Received an event for node: 67406cdd11fb139cb87df94c
11/22/2024 11:54:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdd11fb139cb87df94c
11/22/2024 11:54:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2811fb139cb87e035b
11/22/2024 11:54:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2811fb139cb87e035c
11/22/2024 11:54:27 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2811fb139cb87e035d
11/22/2024 11:54:27 AM UTC [INFO] Received an event for node: 67406d0511fb139cb87dfa61
11/22/2024 11:55:24 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0511fb139cb87dfa61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0511fb139cb87dfa61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:55:25 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:29cb1974486c8448b1631856ac11a50e571c1f49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29cb1974486c8448b1631856ac11a50e571c1f49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:55:25 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:55:25 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0511fb139cb87dfa61
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0363
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0364
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0365
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0366
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0367
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0368
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0369
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036b
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036c
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036d
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036e
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e036f
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0370
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0371
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0372
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0373
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0374
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0375
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0376
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0377
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0378
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0379
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037b
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037c
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037d
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037e
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e037f
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0380
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0381
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0382
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0383
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0384
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0385
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0386
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0387
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0388
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0389
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038b
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038c
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038d
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038e
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e038f
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0390
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0391
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0392
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0393
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0394
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0395
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0396
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0397
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0398
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e0399
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039b
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039c
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039d
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039e
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e039f
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a1
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a2
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a4
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a5
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a6
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a7
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a8
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03a9
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03aa
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ab
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ac
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ad
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ae
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03af
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b1
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b2
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b4
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b5
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b6
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b7
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b8
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03b9
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ba
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03bb
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03bc
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03bd
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03be
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03bf
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c1
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c2
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c4
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c5
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c6
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c7
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c8
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03c9
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ca
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03cb
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03cc
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03cd
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ce
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03cf
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d1
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d2
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d4
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d5
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d6
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d7
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d8
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03d9
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03da
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03db
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03dc
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03dd
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03de
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03df
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03e0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03e1
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03e2
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03e3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cb1974486c8448b1631856ac11a50e571c1f49
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cb1974486c8448b1631856ac11a50e571c1f49
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3
11/22/2024 11:55:25 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3
11/22/2024 11:55:26 AM UTC [INFO] Received an event for node: 67406cd811fb139cb87df928
11/22/2024 11:55:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cd811fb139cb87df928
11/22/2024 11:55:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3011fb139cb87e03e9
11/22/2024 11:55:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3011fb139cb87e03ea
11/22/2024 11:55:29 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3011fb139cb87e03eb
11/22/2024 11:55:29 AM UTC [INFO] Received an event for node: 67406cde11fb139cb87df954
11/22/2024 11:55:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cde11fb139cb87df954
11/22/2024 11:55:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3211fb139cb87e03f1
11/22/2024 11:55:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3211fb139cb87e03f2
11/22/2024 11:55:33 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3211fb139cb87e03f3
11/22/2024 11:55:34 AM UTC [INFO] Received an event for node: 67406cf511fb139cb87df9f0
11/22/2024 11:55:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf511fb139cb87df9f0
11/22/2024 11:55:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3311fb139cb87e03f9
11/22/2024 11:55:36 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3311fb139cb87e03fa
11/22/2024 11:55:37 AM UTC [INFO] Received an event for node: 67406d0611fb139cb87dfa67
11/22/2024 11:56:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0611fb139cb87dfa67
11/22/2024 11:56:34 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e0449
11/22/2024 11:56:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e044b
11/22/2024 11:56:35 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e044c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0611fb139cb87dfa67
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0400
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0401
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0402
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0403
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0404
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0405
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0406
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0407
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0408
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0409
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e040f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0410
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0411
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0412
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0413
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0414
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0415
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0416
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0417
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0418
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e0419
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e041f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0420
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0421
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0422
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0423
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0424
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0425
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0426
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0427
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0428
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0429
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e042f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0430
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0431
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0432
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0433
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0434
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0435
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0436
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0437
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0438
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0439
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e043f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0440
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0441
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0442
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0443
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0444
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0445
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0446
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0447
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0448
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0449
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0450
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0451
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0452
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0453
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0454
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0455
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0456
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0457
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0458
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0459
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e045f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0460
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0461
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0462
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0463
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0464
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0465
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0466
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0467
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0468
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0469
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e046f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0470
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0471
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0472
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0473
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0474
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0475
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0476
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0477
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0478
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0479
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047a
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047b
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047c
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047d
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047e
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e047f
11/22/2024 11:56:35 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0480
11/22/2024 11:56:35 AM UTC [INFO] Received an event for node: 67406d5111fb139cb87dfc21
11/22/2024 11:56:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5111fb139cb87dfc21
11/22/2024 11:56:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3c11fb139cb87e0486
11/22/2024 11:56:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3c11fb139cb87e0487
11/22/2024 11:56:38 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3c11fb139cb87e0488
11/22/2024 11:56:38 AM UTC [INFO] Received an event for node: 67406ce911fb139cb87df999
11/22/2024 11:56:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce911fb139cb87df999
11/22/2024 11:56:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4311fb139cb87e048e
11/22/2024 11:56:40 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4311fb139cb87e048f
11/22/2024 11:56:40 AM UTC [INFO] Received an event for node: 67406cfb11fb139cb87dfa17
11/22/2024 11:56:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfb11fb139cb87dfa17
11/22/2024 11:56:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4911fb139cb87e0495
11/22/2024 11:56:42 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4911fb139cb87e0496
11/22/2024 11:56:42 AM UTC [INFO] Received an event for node: 67406cde11fb139cb87df951
11/22/2024 11:56:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cde11fb139cb87df951
11/22/2024 11:56:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e049c
11/22/2024 11:56:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e049d
11/22/2024 11:56:44 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e049e
11/22/2024 11:56:45 AM UTC [INFO] Received an event for node: 67406cea11fb139cb87df9a5
11/22/2024 11:56:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cea11fb139cb87df9a5
11/22/2024 11:56:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e04a4
11/22/2024 11:56:47 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e04a5
11/22/2024 11:56:47 AM UTC [INFO] Received an event for node: 67406cfe11fb139cb87dfa2f
11/22/2024 11:56:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfe11fb139cb87dfa2f
11/22/2024 11:56:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e04ab
11/22/2024 11:56:49 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4d11fb139cb87e04ac
11/22/2024 11:56:49 AM UTC [INFO] Received an event for node: 67406cda11fb139cb87df934
11/22/2024 11:56:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cda11fb139cb87df934
11/22/2024 11:56:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b2
11/22/2024 11:56:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b3
11/22/2024 11:56:51 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b4
11/22/2024 11:56:51 AM UTC [INFO] Received an event for node: 67406ce011fb139cb87df963
11/22/2024 11:56:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce011fb139cb87df963
11/22/2024 11:56:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f4
11/22/2024 11:56:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f6
11/22/2024 11:56:54 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f8
11/22/2024 11:56:54 AM UTC [INFO] Received an event for node: 67406cff11fb139cb87dfa37
11/22/2024 11:57:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406cff11fb139cb87dfa37
11/22/2024 11:57:54 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050b
11/22/2024 11:57:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050d
11/22/2024 11:57:55 AM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050e
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cff11fb139cb87dfa37
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b8
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b9
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04bb
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04bd
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04be
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04bf
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c0
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c1
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c2
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c3
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c4
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c5
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c6
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c7
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c8
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04c9
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04ca
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04cb
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04cc
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04cd
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ce
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04cf
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d0
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d1
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d2
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d3
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d4
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d5
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d6
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d7
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d8
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04d9
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04da
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04db
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04dc
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04dd
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04de
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04df
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e0
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e1
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e2
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e3
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e4
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e5
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e6
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e7
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e8
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04e9
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ea
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04eb
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ec
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ed
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ee
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ef
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f0
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f1
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f3
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f5
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f7
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04f9
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04fb
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04fd
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e04ff
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0501
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0502
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0503
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0504
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0505
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0506
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0507
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0508
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0509
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050a
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050b
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050c
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050d
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050e
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050f
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0510
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0511
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0512
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0513
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0514
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0515
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0516
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0517
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0518
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0519
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051a
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051b
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051c
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051d
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051e
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e051f
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0520
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0521
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0522
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0523
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0524
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0525
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0526
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0527
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0528
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0529
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052a
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052b
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052c
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052d
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052e
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e052f
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0530
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0531
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0532
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0533
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0534
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0535
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0536
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0537
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0538
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0539
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053a
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053b
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053c
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053d
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053e
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e053f
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0540
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0541
11/22/2024 11:57:55 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e0542
11/22/2024 11:57:55 AM UTC [INFO] Received an event for node: 67406cdb11fb139cb87df940
11/22/2024 11:57:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cdb11fb139cb87df940
11/22/2024 11:57:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0548
11/22/2024 11:57:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e054a
11/22/2024 11:57:58 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e054d
11/22/2024 11:57:58 AM UTC [INFO] Received an event for node: 67406cfb11fb139cb87dfa1a
11/22/2024 11:58:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfb11fb139cb87dfa1a
11/22/2024 11:58:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e055a
11/22/2024 11:58:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e055c
11/22/2024 11:58:00 AM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa70
11/22/2024 11:58:56 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:58:56 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:58:57 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:58:57 AM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa70
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e054b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e054c
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e054f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0550
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0553
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0555
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0556
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0557
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0559
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e055b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e055d
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e055f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0561
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0563
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0565
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0566
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0567
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0568
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0569
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056c
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056d
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e056f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0570
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0571
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0572
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0573
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0574
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0575
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0576
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0577
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0578
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0579
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057c
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057d
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e057f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0580
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0581
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0582
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0583
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0584
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0585
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0586
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0587
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0588
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0589
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e058a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e058b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e058c
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e058d
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e058e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e058f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0590
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0591
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0592
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0593
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0594
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0595
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0596
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0597
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0598
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e0599
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059b
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059c
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059d
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e059f
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a0
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a1
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a2
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a3
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a4
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a5
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a6
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a7
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a8
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a9
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05aa
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ab
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ac
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ad
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ae
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05af
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b0
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b1
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b2
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b3
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b4
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b5
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b6
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b7
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b8
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05b9
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ba
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05bb
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05bc
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05bd
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05be
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05bf
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c0
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c1
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c2
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c3
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c4
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c5
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c6
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c7
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c8
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05c9
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ca
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05cb
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05cc
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05cd
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05ce
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05cf
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d0
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d1
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d2
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d3
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d4
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d5
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d6
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05d7
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce
11/22/2024 11:58:57 AM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce
11/22/2024 11:58:57 AM UTC [INFO] Received an event for node: 67406ce811fb139cb87df996
11/22/2024 11:59:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce811fb139cb87df996
11/22/2024 11:59:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5911fb139cb87e05dd
11/22/2024 11:59:00 AM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5911fb139cb87e05de
11/22/2024 11:59:00 AM UTC [INFO] Received an event for node: 67406d0811fb139cb87dfa76
11/22/2024 12:00:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0811fb139cb87dfa76
11/22/2024 12:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05ed
11/22/2024 12:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05ee
11/22/2024 12:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05ef
11/22/2024 12:01:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f0
11/22/2024 12:01:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f1
11/22/2024 12:01:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f2
11/22/2024 12:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f3
11/22/2024 12:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f4
11/22/2024 12:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f5
11/22/2024 12:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f6
11/22/2024 12:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f7
11/22/2024 12:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f8
11/22/2024 12:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05f9
11/22/2024 12:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05fa
11/22/2024 12:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05fb
11/22/2024 12:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05fc
11/22/2024 12:01:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05fd
11/22/2024 12:01:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05fe
11/22/2024 12:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e05ff
11/22/2024 12:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0600
11/22/2024 12:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0601
11/22/2024 12:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0602
11/22/2024 12:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0603
11/22/2024 12:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0604
11/22/2024 12:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0605
11/22/2024 12:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0606
11/22/2024 12:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0607
11/22/2024 12:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0608
11/22/2024 12:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0609
11/22/2024 12:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060a
11/22/2024 12:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060b
11/22/2024 12:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060c
11/22/2024 12:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060d
11/22/2024 12:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060e
11/22/2024 12:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e060f
11/22/2024 12:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0610
11/22/2024 12:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0611
11/22/2024 12:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0612
11/22/2024 12:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0613
11/22/2024 12:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0614
11/22/2024 12:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0615
11/22/2024 12:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0616
11/22/2024 12:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0617
11/22/2024 12:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0618
11/22/2024 12:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0619
11/22/2024 12:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061a
11/22/2024 12:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061b
11/22/2024 12:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061c
11/22/2024 12:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061d
11/22/2024 12:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061e
11/22/2024 12:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e061f
11/22/2024 12:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0620
11/22/2024 12:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0621
11/22/2024 12:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0622
11/22/2024 12:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0623
11/22/2024 12:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0624
11/22/2024 12:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0625
11/22/2024 12:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0626
11/22/2024 12:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0627
11/22/2024 12:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0628
11/22/2024 12:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0629
11/22/2024 12:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062a
11/22/2024 12:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062b
11/22/2024 12:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062c
11/22/2024 12:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062d
11/22/2024 12:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062e
11/22/2024 12:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e062f
11/22/2024 12:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0630
11/22/2024 12:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0631
11/22/2024 12:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0632
11/22/2024 12:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0633
11/22/2024 12:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0634
11/22/2024 12:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0635
11/22/2024 12:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0636
11/22/2024 12:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0637
11/22/2024 12:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0638
11/22/2024 12:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0639
11/22/2024 12:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063a
11/22/2024 12:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063b
11/22/2024 12:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063c
11/22/2024 12:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063d
11/22/2024 12:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063e
11/22/2024 12:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e063f
11/22/2024 12:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0640
11/22/2024 12:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0641
11/22/2024 12:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0642
11/22/2024 12:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0643
11/22/2024 12:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0644
11/22/2024 12:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0645
11/22/2024 12:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0646
11/22/2024 12:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0647
11/22/2024 12:01:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0648
11/22/2024 12:01:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0649
11/22/2024 12:01:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064a
11/22/2024 12:01:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064b
11/22/2024 12:01:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064c
11/22/2024 12:01:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064d
11/22/2024 12:01:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064e
11/22/2024 12:01:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e064f
11/22/2024 12:01:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0650
11/22/2024 12:01:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0651
11/22/2024 12:01:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0652
11/22/2024 12:01:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0653
11/22/2024 12:01:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0654
11/22/2024 12:01:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0655
11/22/2024 12:01:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0656
11/22/2024 12:01:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0657
11/22/2024 12:01:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0658
11/22/2024 12:01:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0659
11/22/2024 12:01:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065a
11/22/2024 12:01:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065b
11/22/2024 12:01:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065c
11/22/2024 12:01:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065d
11/22/2024 12:01:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065e
11/22/2024 12:01:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e065f
11/22/2024 12:01:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0660
11/22/2024 12:01:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0661
11/22/2024 12:01:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0662
11/22/2024 12:01:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0663
11/22/2024 12:01:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0664
11/22/2024 12:01:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0665
11/22/2024 12:01:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0666
11/22/2024 12:01:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0667
11/22/2024 12:01:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0668
11/22/2024 12:01:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0669
11/22/2024 12:01:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066a
11/22/2024 12:01:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066b
11/22/2024 12:01:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066c
11/22/2024 12:01:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066d
11/22/2024 12:01:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066e
11/22/2024 12:01:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e066f
11/22/2024 12:01:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0670
11/22/2024 12:01:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0671
11/22/2024 12:01:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0672
11/22/2024 12:01:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0673
11/22/2024 12:01:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0674
11/22/2024 12:01:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0675
11/22/2024 12:01:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0676
11/22/2024 12:01:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0677
11/22/2024 12:01:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0678
11/22/2024 12:01:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0679
11/22/2024 12:01:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067a
11/22/2024 12:01:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067b
11/22/2024 12:01:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067c
11/22/2024 12:01:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067d
11/22/2024 12:01:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067e
11/22/2024 12:01:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e067f
11/22/2024 12:01:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0680
11/22/2024 12:01:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0681
11/22/2024 12:01:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0682
11/22/2024 12:01:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0683
11/22/2024 12:01:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0684
11/22/2024 12:01:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0685
11/22/2024 12:01:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0686
11/22/2024 12:01:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0687
11/22/2024 12:01:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0688
11/22/2024 12:01:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0689
11/22/2024 12:01:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068a
11/22/2024 12:01:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068b
11/22/2024 12:01:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068c
11/22/2024 12:01:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068d
11/22/2024 12:01:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068e
11/22/2024 12:01:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e068f
11/22/2024 12:01:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0690
11/22/2024 12:01:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0691
11/22/2024 12:01:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0692
11/22/2024 12:01:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0693
11/22/2024 12:01:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0694
11/22/2024 12:01:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0695
11/22/2024 12:01:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0696
11/22/2024 12:01:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0697
11/22/2024 12:01:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0698
11/22/2024 12:01:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e0699
11/22/2024 12:01:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069a
11/22/2024 12:01:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069b
11/22/2024 12:01:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069c
11/22/2024 12:01:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069d
11/22/2024 12:01:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069e
11/22/2024 12:01:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e069f
11/22/2024 12:01:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a0
11/22/2024 12:01:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a1
11/22/2024 12:01:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a2
11/22/2024 12:01:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a3
11/22/2024 12:01:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a4
11/22/2024 12:01:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a5
11/22/2024 12:01:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a6
11/22/2024 12:01:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a7
11/22/2024 12:01:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a8
11/22/2024 12:02:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06a9
11/22/2024 12:02:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06aa
11/22/2024 12:02:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06ab
11/22/2024 12:02:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06ac
11/22/2024 12:02:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06ad
11/22/2024 12:02:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06ae
11/22/2024 12:02:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06af
11/22/2024 12:02:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b0
11/22/2024 12:02:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b1
11/22/2024 12:02:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b2
11/22/2024 12:02:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b3
11/22/2024 12:02:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b4
11/22/2024 12:02:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b5
11/22/2024 12:02:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b6
11/22/2024 12:02:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b7
11/22/2024 12:02:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b8
11/22/2024 12:02:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06b9
11/22/2024 12:02:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06ba
11/22/2024 12:02:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06bb
11/22/2024 12:02:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06bc
11/22/2024 12:02:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06bd
11/22/2024 12:02:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06be
11/22/2024 12:02:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06bf
11/22/2024 12:02:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c0
11/22/2024 12:02:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c1
11/22/2024 12:02:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c2
11/22/2024 12:02:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c3
11/22/2024 12:02:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c4
11/22/2024 12:02:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c5
11/22/2024 12:02:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5a11fb139cb87e06c6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0811fb139cb87dfa76
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e4
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e5
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e7
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e8
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05e9
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ea
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05eb
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ec
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ed
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ee
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ef
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f0
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f1
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f2
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f3
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f4
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f5
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f7
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f8
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05f9
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05fa
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05fb
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05fc
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05fd
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05fe
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e05ff
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0600
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0601
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0602
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0603
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0604
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0605
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0606
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0607
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0608
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0609
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e060f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0610
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0611
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0612
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0613
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0614
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0615
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0616
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0617
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0618
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0619
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e061f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0620
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0621
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0622
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0623
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0624
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0625
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0626
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0627
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0628
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0629
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e062f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0630
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0631
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0632
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0633
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0634
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0635
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0636
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0637
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0638
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0639
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e063f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0640
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0641
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0642
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0643
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0644
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0645
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0646
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0647
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0648
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0649
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e064f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0650
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0651
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0652
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0653
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0654
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0655
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0656
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0657
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0658
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0659
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e065f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0660
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0661
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0662
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0663
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0664
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0665
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0666
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0667
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0668
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0669
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e066f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0670
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0671
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0672
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0673
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0674
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0675
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0676
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0677
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0678
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0679
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e067f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0680
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0681
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0682
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0683
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0684
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0685
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0686
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0687
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0688
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0689
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e068f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0690
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0691
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0692
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0693
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0694
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0695
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0696
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0697
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0698
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e0699
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069a
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069b
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069c
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069d
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069e
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e069f
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a0
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a1
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a2
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a3
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a4
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a5
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a7
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a8
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06a9
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06aa
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06ab
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06ac
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06ad
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06ae
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06af
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b0
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b1
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b2
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b3
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b4
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b5
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b7
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b8
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06b9
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06ba
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06bb
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06bc
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06bd
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06be
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06bf
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c0
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c1
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c2
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c3
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c4
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c5
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c6
11/22/2024 12:02:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5a11fb139cb87e06c7
11/22/2024 12:02:09 PM UTC [INFO] Received an event for node: 67406ce611fb139cb87df984
11/22/2024 12:02:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce611fb139cb87df984
11/22/2024 12:02:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5b11fb139cb87e06cd
11/22/2024 12:02:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5b11fb139cb87e06ce
11/22/2024 12:02:11 PM UTC [INFO] Received an event for node: 67406d0e11fb139cb87dfa9d
11/22/2024 12:04:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0e11fb139cb87dfa9d
11/22/2024 12:04:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06dd
11/22/2024 12:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06de
11/22/2024 12:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06df
11/22/2024 12:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e0
11/22/2024 12:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e1
11/22/2024 12:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e2
11/22/2024 12:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e3
11/22/2024 12:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e4
11/22/2024 12:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e5
11/22/2024 12:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e6
11/22/2024 12:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e7
11/22/2024 12:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e8
11/22/2024 12:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06e9
11/22/2024 12:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06ea
11/22/2024 12:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06eb
11/22/2024 12:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5d11fb139cb87e06ec
11/22/2024 12:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06ed
11/22/2024 12:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06ee
11/22/2024 12:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06ef
11/22/2024 12:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f0
11/22/2024 12:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f1
11/22/2024 12:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f2
11/22/2024 12:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f3
11/22/2024 12:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f4
11/22/2024 12:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f5
11/22/2024 12:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f6
11/22/2024 12:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f7
11/22/2024 12:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f8
11/22/2024 12:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06f9
11/22/2024 12:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06fa
11/22/2024 12:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06fb
11/22/2024 12:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06fc
11/22/2024 12:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06fd
11/22/2024 12:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06fe
11/22/2024 12:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e06ff
11/22/2024 12:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0700
11/22/2024 12:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0701
11/22/2024 12:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0702
11/22/2024 12:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0703
11/22/2024 12:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0704
11/22/2024 12:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0705
11/22/2024 12:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0706
11/22/2024 12:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0707
11/22/2024 12:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0708
11/22/2024 12:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0709
11/22/2024 12:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070a
11/22/2024 12:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070b
11/22/2024 12:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070c
11/22/2024 12:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070d
11/22/2024 12:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070e
11/22/2024 12:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e070f
11/22/2024 12:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0710
11/22/2024 12:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0711
11/22/2024 12:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0712
11/22/2024 12:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0713
11/22/2024 12:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0714
11/22/2024 12:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0715
11/22/2024 12:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0716
11/22/2024 12:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0717
11/22/2024 12:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0718
11/22/2024 12:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0719
11/22/2024 12:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071a
11/22/2024 12:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071b
11/22/2024 12:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071c
11/22/2024 12:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071d
11/22/2024 12:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071e
11/22/2024 12:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e071f
11/22/2024 12:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0720
11/22/2024 12:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0721
11/22/2024 12:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0722
11/22/2024 12:04:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0723
11/22/2024 12:04:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0724
11/22/2024 12:04:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0725
11/22/2024 12:04:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0726
11/22/2024 12:04:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0727
11/22/2024 12:04:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0728
11/22/2024 12:04:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0729
11/22/2024 12:04:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072a
11/22/2024 12:04:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072b
11/22/2024 12:04:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072c
11/22/2024 12:04:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072d
11/22/2024 12:04:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072e
11/22/2024 12:04:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e072f
11/22/2024 12:04:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0730
11/22/2024 12:04:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0731
11/22/2024 12:04:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0732
11/22/2024 12:04:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0733
11/22/2024 12:04:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0734
11/22/2024 12:04:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0735
11/22/2024 12:04:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0736
11/22/2024 12:04:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0737
11/22/2024 12:04:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0738
11/22/2024 12:04:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0739
11/22/2024 12:04:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073a
11/22/2024 12:04:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073b
11/22/2024 12:04:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073c
11/22/2024 12:04:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073d
11/22/2024 12:04:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073e
11/22/2024 12:04:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e073f
11/22/2024 12:04:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0740
11/22/2024 12:04:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0741
11/22/2024 12:04:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0742
11/22/2024 12:04:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0743
11/22/2024 12:04:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0744
11/22/2024 12:04:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0745
11/22/2024 12:04:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0746
11/22/2024 12:04:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0747
11/22/2024 12:04:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0748
11/22/2024 12:04:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0749
11/22/2024 12:04:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074a
11/22/2024 12:04:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074b
11/22/2024 12:04:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074c
11/22/2024 12:04:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074d
11/22/2024 12:04:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074e
11/22/2024 12:04:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e074f
11/22/2024 12:04:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0750
11/22/2024 12:04:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0751
11/22/2024 12:04:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0752
11/22/2024 12:04:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0753
11/22/2024 12:04:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0754
11/22/2024 12:04:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0755
11/22/2024 12:04:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0756
11/22/2024 12:04:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0757
11/22/2024 12:04:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0758
11/22/2024 12:04:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0759
11/22/2024 12:04:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075a
11/22/2024 12:04:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075b
11/22/2024 12:04:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075c
11/22/2024 12:04:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075d
11/22/2024 12:04:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075e
11/22/2024 12:04:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e075f
11/22/2024 12:04:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0760
11/22/2024 12:04:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0761
11/22/2024 12:04:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0762
11/22/2024 12:04:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0763
11/22/2024 12:04:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0764
11/22/2024 12:04:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0765
11/22/2024 12:04:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0766
11/22/2024 12:04:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0767
11/22/2024 12:04:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0768
11/22/2024 12:04:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0769
11/22/2024 12:04:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076a
11/22/2024 12:04:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076b
11/22/2024 12:04:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076c
11/22/2024 12:04:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076d
11/22/2024 12:04:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076e
11/22/2024 12:04:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e076f
11/22/2024 12:04:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0770
11/22/2024 12:04:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0771
11/22/2024 12:04:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0772
11/22/2024 12:04:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0773
11/22/2024 12:04:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0774
11/22/2024 12:04:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0775
11/22/2024 12:04:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0776
11/22/2024 12:04:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0777
11/22/2024 12:04:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0778
11/22/2024 12:04:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0779
11/22/2024 12:04:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077a
11/22/2024 12:04:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077b
11/22/2024 12:04:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077c
11/22/2024 12:04:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077d
11/22/2024 12:04:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077e
11/22/2024 12:05:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e077f
11/22/2024 12:05:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0780
11/22/2024 12:05:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0781
11/22/2024 12:05:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0782
11/22/2024 12:05:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0783
11/22/2024 12:05:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0784
11/22/2024 12:05:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0785
11/22/2024 12:05:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0786
11/22/2024 12:05:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0787
11/22/2024 12:05:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0788
11/22/2024 12:05:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0789
11/22/2024 12:05:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078a
11/22/2024 12:05:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078b
11/22/2024 12:05:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078c
11/22/2024 12:05:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078d
11/22/2024 12:05:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078e
11/22/2024 12:05:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e078f
11/22/2024 12:05:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0790
11/22/2024 12:05:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0791
11/22/2024 12:05:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0792
11/22/2024 12:05:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0793
11/22/2024 12:05:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0794
11/22/2024 12:05:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0795
11/22/2024 12:05:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0796
11/22/2024 12:05:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0797
11/22/2024 12:05:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0798
11/22/2024 12:05:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e0799
11/22/2024 12:05:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079a
11/22/2024 12:05:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079b
11/22/2024 12:05:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079c
11/22/2024 12:05:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079d
11/22/2024 12:05:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079e
11/22/2024 12:05:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e079f
11/22/2024 12:05:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a0
11/22/2024 12:05:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a1
11/22/2024 12:05:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a2
11/22/2024 12:05:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a3
11/22/2024 12:05:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a4
11/22/2024 12:05:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a5
11/22/2024 12:05:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a6
11/22/2024 12:05:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a7
11/22/2024 12:05:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a8
11/22/2024 12:05:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07a9
11/22/2024 12:05:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07aa
11/22/2024 12:05:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07ab
11/22/2024 12:05:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07ac
11/22/2024 12:05:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07ad
11/22/2024 12:05:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07ae
11/22/2024 12:05:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07af
11/22/2024 12:05:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b0
11/22/2024 12:05:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b1
11/22/2024 12:05:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b2
11/22/2024 12:05:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b3
11/22/2024 12:05:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b4
11/22/2024 12:05:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b5
11/22/2024 12:05:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e5e11fb139cb87e07b6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0e11fb139cb87dfa9d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d4
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d5
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d7
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d8
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06d9
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06da
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06db
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06dc
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06dd
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06de
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06df
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e0
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e1
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e2
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e3
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e4
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e5
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e7
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e8
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06e9
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06ea
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06eb
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5d11fb139cb87e06ec
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06ed
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06ee
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06ef
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f0
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f1
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f2
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f3
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f4
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f5
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f7
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f8
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06f9
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06fa
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06fb
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06fc
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06fd
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06fe
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e06ff
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0700
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0701
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0702
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0703
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0704
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0705
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0706
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0707
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0708
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0709
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e070f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0710
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0711
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0712
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0713
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0714
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0715
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0716
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0717
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0718
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0719
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e071f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0720
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0721
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0722
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0723
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0724
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0725
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0726
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0727
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0728
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0729
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e072f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0730
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0731
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0732
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0733
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0734
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0735
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0736
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0737
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0738
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0739
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e073f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0740
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0741
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0742
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0743
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0744
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0745
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0746
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0747
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0748
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0749
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e074f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0750
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0751
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0752
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0753
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0754
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0755
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0756
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0757
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0758
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0759
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e075f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0760
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0761
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0762
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0763
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0764
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0765
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0766
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0767
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0768
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0769
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e076f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0770
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0771
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0772
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0773
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0774
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0775
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0776
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0777
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0778
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0779
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e077f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0780
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0781
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0782
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0783
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0784
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0785
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0786
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0787
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0788
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0789
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e078f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0790
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0791
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0792
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0793
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0794
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0795
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0796
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0797
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0798
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e0799
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079a
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079b
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079c
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079d
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079e
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e079f
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a0
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a1
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a2
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a3
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a4
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a5
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a7
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a8
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07a9
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07aa
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07ab
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07ac
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07ad
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07ae
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07af
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b0
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b1
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b2
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b3
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b4
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b5
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b6
11/22/2024 12:05:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07b7
11/22/2024 12:05:18 PM UTC [INFO] Received an event for node: 67406cfd11fb139cb87dfa26
11/22/2024 12:05:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfd11fb139cb87dfa26
11/22/2024 12:05:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07bd
11/22/2024 12:05:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5e11fb139cb87e07be
11/22/2024 12:05:20 PM UTC [INFO] Received an event for node: 67406d1c11fb139cb87dfaff
11/22/2024 12:05:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1c11fb139cb87dfaff
11/22/2024 12:05:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6711fb139cb87e07c4
11/22/2024 12:05:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6711fb139cb87e07c5
11/22/2024 12:05:22 PM UTC [INFO] Received an event for node: 67406cf711fb139cb87df9fc
11/22/2024 12:05:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf711fb139cb87df9fc
11/22/2024 12:05:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6c11fb139cb87e07cb
11/22/2024 12:05:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6c11fb139cb87e07cc
11/22/2024 12:05:24 PM UTC [INFO] Received an event for node: 67406d3211fb139cb87dfb6f
11/22/2024 12:05:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3211fb139cb87dfb6f
11/22/2024 12:05:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6d11fb139cb87e07d2
11/22/2024 12:05:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6d11fb139cb87e07d3
11/22/2024 12:05:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6d11fb139cb87e07d4
11/22/2024 12:05:27 PM UTC [INFO] Received an event for node: 67406d0611fb139cb87dfa64
11/22/2024 12:06:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0611fb139cb87dfa64
11/22/2024 12:06:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0823
11/22/2024 12:06:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0825
11/22/2024 12:06:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0826
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0611fb139cb87dfa64
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07da
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07db
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07dc
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07dd
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07de
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07df
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e0
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e1
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e2
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e3
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e4
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e5
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e6
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e7
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e8
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07e9
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ea
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07eb
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ec
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ed
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ee
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ef
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f0
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f1
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f2
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f3
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f4
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f5
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f6
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f7
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f8
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07f9
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07fa
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07fb
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07fc
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07fd
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07fe
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07ff
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0800
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0801
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0802
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0803
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0804
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0805
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0806
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0807
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0808
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0809
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080a
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080b
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080c
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080d
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080e
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e080f
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0810
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0811
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0812
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0813
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0814
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0815
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0816
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0817
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0818
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0819
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081a
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081b
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081c
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081d
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081e
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e081f
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0820
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0821
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0822
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0823
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0824
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0825
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0826
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0827
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0828
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0829
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082a
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082b
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082c
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082d
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082e
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e082f
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0830
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0831
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0832
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0833
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0834
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0835
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0836
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0837
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0838
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0839
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083a
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083b
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083c
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083d
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083e
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e083f
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0840
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0841
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0842
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0843
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0844
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0845
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0846
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0847
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0848
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0849
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084a
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084b
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084c
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084d
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084e
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e084f
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0850
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0851
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0852
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0853
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0854
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0855
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0856
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0857
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0858
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0859
11/22/2024 12:06:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e085a
11/22/2024 12:06:39 PM UTC [INFO] Received an event for node: 67406d4f11fb139cb87dfc13
11/22/2024 12:06:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d4f11fb139cb87dfc13
11/22/2024 12:06:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0889
11/22/2024 12:06:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e088b
11/22/2024 12:06:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e088d
11/22/2024 12:06:42 PM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa40
11/22/2024 12:07:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa40
11/22/2024 12:07:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b1
11/22/2024 12:07:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b3
11/22/2024 12:07:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa40
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0860
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0861
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0862
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0863
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0864
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0865
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0866
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0867
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0868
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0869
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086a
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086b
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086c
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086d
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086e
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e086f
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0870
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0871
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0872
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0873
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0874
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0875
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0876
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0877
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0878
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0879
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087a
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087b
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087c
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087d
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087e
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e087f
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0880
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0881
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0882
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0883
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0884
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0885
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0886
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0888
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e088a
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e088c
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e088e
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0890
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0893
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0895
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0896
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0897
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0898
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e0899
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089a
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089b
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089c
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089d
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089e
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e089f
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a0
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a1
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a2
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a3
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a5
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a6
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a7
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a8
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08a9
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08aa
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ab
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ac
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ad
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ae
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08af
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b0
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b1
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b2
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b3
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b5
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b6
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b7
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b8
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b9
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ba
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08bb
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08bc
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08bd
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08be
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08bf
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c0
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c1
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c2
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c3
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c5
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c6
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c7
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c8
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08c9
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ca
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08cb
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08cc
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08cd
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08ce
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08cf
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d0
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d1
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d2
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d3
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d5
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d6
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d7
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d8
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08d9
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08da
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08db
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08dc
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08dd
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08de
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08df
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e0
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e1
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e2
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e3
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e4
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e5
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e6
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e7
11/22/2024 12:07:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08e8
11/22/2024 12:07:47 PM UTC [INFO] Received an event for node: 67406ce511fb139cb87df97e
11/22/2024 12:07:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce511fb139cb87df97e
11/22/2024 12:07:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08ee
11/22/2024 12:07:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f0
11/22/2024 12:07:50 PM UTC [INFO] Received an event for node: 67406d0c11fb139cb87dfa8b
11/22/2024 12:09:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0c11fb139cb87dfa8b
11/22/2024 12:09:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e08fe
11/22/2024 12:09:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e08ff
11/22/2024 12:09:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0900
11/22/2024 12:09:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0901
11/22/2024 12:09:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0902
11/22/2024 12:09:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0903
11/22/2024 12:09:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0904
11/22/2024 12:09:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0905
11/22/2024 12:09:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0906
11/22/2024 12:09:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0907
11/22/2024 12:09:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0908
11/22/2024 12:09:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e0909
11/22/2024 12:09:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e090a
11/22/2024 12:09:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e090b
11/22/2024 12:09:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e090c
11/22/2024 12:09:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e090d
11/22/2024 12:09:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7711fb139cb87e090e
11/22/2024 12:09:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e090f
11/22/2024 12:09:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0910
11/22/2024 12:09:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0911
11/22/2024 12:09:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0912
11/22/2024 12:09:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0913
11/22/2024 12:09:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0914
11/22/2024 12:09:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0915
11/22/2024 12:09:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0916
11/22/2024 12:09:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0917
11/22/2024 12:09:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0918
11/22/2024 12:09:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0919
11/22/2024 12:09:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091a
11/22/2024 12:09:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091b
11/22/2024 12:09:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091c
11/22/2024 12:09:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091d
11/22/2024 12:09:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091e
11/22/2024 12:09:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e091f
11/22/2024 12:09:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0920
11/22/2024 12:09:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0921
11/22/2024 12:09:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0922
11/22/2024 12:09:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0923
11/22/2024 12:09:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0924
11/22/2024 12:09:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0925
11/22/2024 12:09:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0926
11/22/2024 12:09:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0927
11/22/2024 12:09:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0928
11/22/2024 12:09:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0929
11/22/2024 12:09:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092a
11/22/2024 12:10:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092b
11/22/2024 12:10:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092c
11/22/2024 12:10:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092d
11/22/2024 12:10:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092e
11/22/2024 12:10:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e092f
11/22/2024 12:10:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0930
11/22/2024 12:10:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0931
11/22/2024 12:10:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0932
11/22/2024 12:10:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0933
11/22/2024 12:10:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0934
11/22/2024 12:10:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0935
11/22/2024 12:10:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0936
11/22/2024 12:10:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0937
11/22/2024 12:10:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0938
11/22/2024 12:10:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0939
11/22/2024 12:10:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093a
11/22/2024 12:10:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093b
11/22/2024 12:10:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093c
11/22/2024 12:10:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093d
11/22/2024 12:10:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093e
11/22/2024 12:10:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e093f
11/22/2024 12:10:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0940
11/22/2024 12:10:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0941
11/22/2024 12:10:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0942
11/22/2024 12:10:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0943
11/22/2024 12:10:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0944
11/22/2024 12:10:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0945
11/22/2024 12:10:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0946
11/22/2024 12:10:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0947
11/22/2024 12:10:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0948
11/22/2024 12:10:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0949
11/22/2024 12:10:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094a
11/22/2024 12:10:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094b
11/22/2024 12:10:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094c
11/22/2024 12:10:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094d
11/22/2024 12:10:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094e
11/22/2024 12:10:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e094f
11/22/2024 12:10:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0950
11/22/2024 12:10:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0951
11/22/2024 12:10:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0952
11/22/2024 12:10:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0953
11/22/2024 12:10:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0954
11/22/2024 12:10:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0955
11/22/2024 12:10:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0956
11/22/2024 12:10:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0957
11/22/2024 12:10:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0958
11/22/2024 12:10:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0959
11/22/2024 12:10:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095a
11/22/2024 12:10:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095b
11/22/2024 12:10:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095c
11/22/2024 12:10:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095d
11/22/2024 12:10:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095e
11/22/2024 12:10:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e095f
11/22/2024 12:10:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0960
11/22/2024 12:10:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0961
11/22/2024 12:10:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0962
11/22/2024 12:10:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0963
11/22/2024 12:10:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0964
11/22/2024 12:10:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0965
11/22/2024 12:10:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0966
11/22/2024 12:10:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0967
11/22/2024 12:10:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0968
11/22/2024 12:10:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0969
11/22/2024 12:10:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096a
11/22/2024 12:10:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096b
11/22/2024 12:10:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096c
11/22/2024 12:10:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096d
11/22/2024 12:10:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096e
11/22/2024 12:10:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e096f
11/22/2024 12:10:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0970
11/22/2024 12:10:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0971
11/22/2024 12:10:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0972
11/22/2024 12:10:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0973
11/22/2024 12:10:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0974
11/22/2024 12:10:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0975
11/22/2024 12:10:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0976
11/22/2024 12:10:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0977
11/22/2024 12:10:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0978
11/22/2024 12:10:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0979
11/22/2024 12:10:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097a
11/22/2024 12:10:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097b
11/22/2024 12:10:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097c
11/22/2024 12:10:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097d
11/22/2024 12:10:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097e
11/22/2024 12:10:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e097f
11/22/2024 12:10:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0980
11/22/2024 12:10:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0981
11/22/2024 12:10:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0982
11/22/2024 12:10:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0983
11/22/2024 12:10:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0984
11/22/2024 12:10:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0985
11/22/2024 12:10:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0986
11/22/2024 12:10:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0987
11/22/2024 12:10:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0988
11/22/2024 12:10:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0989
11/22/2024 12:10:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098a
11/22/2024 12:10:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098b
11/22/2024 12:10:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098c
11/22/2024 12:10:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098d
11/22/2024 12:10:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098e
11/22/2024 12:10:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e098f
11/22/2024 12:10:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0990
11/22/2024 12:10:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0991
11/22/2024 12:10:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0992
11/22/2024 12:10:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0993
11/22/2024 12:10:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0994
11/22/2024 12:10:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0995
11/22/2024 12:10:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0996
11/22/2024 12:10:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0997
11/22/2024 12:10:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0998
11/22/2024 12:10:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e0999
11/22/2024 12:10:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099a
11/22/2024 12:10:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099b
11/22/2024 12:10:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099c
11/22/2024 12:10:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099d
11/22/2024 12:10:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099e
11/22/2024 12:10:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e099f
11/22/2024 12:10:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a0
11/22/2024 12:10:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a1
11/22/2024 12:10:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a2
11/22/2024 12:10:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a3
11/22/2024 12:10:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a4
11/22/2024 12:10:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a5
11/22/2024 12:10:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a6
11/22/2024 12:10:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a7
11/22/2024 12:10:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a8
11/22/2024 12:10:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09a9
11/22/2024 12:10:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09aa
11/22/2024 12:10:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ab
11/22/2024 12:10:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ac
11/22/2024 12:10:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ad
11/22/2024 12:10:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ae
11/22/2024 12:10:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09af
11/22/2024 12:10:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b0
11/22/2024 12:10:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b1
11/22/2024 12:10:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b2
11/22/2024 12:10:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b3
11/22/2024 12:10:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b4
11/22/2024 12:10:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b5
11/22/2024 12:10:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b6
11/22/2024 12:10:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b7
11/22/2024 12:10:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b8
11/22/2024 12:10:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09b9
11/22/2024 12:10:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ba
11/22/2024 12:10:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09bb
11/22/2024 12:10:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09bc
11/22/2024 12:10:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09bd
11/22/2024 12:10:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09be
11/22/2024 12:10:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09bf
11/22/2024 12:10:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c0
11/22/2024 12:10:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c1
11/22/2024 12:10:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c2
11/22/2024 12:10:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c3
11/22/2024 12:10:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c4
11/22/2024 12:10:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c5
11/22/2024 12:10:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c6
11/22/2024 12:10:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c7
11/22/2024 12:10:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c8
11/22/2024 12:10:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09c9
11/22/2024 12:10:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ca
11/22/2024 12:10:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09cb
11/22/2024 12:10:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09cc
11/22/2024 12:10:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09cd
11/22/2024 12:10:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09ce
11/22/2024 12:10:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09cf
11/22/2024 12:10:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d0
11/22/2024 12:10:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d1
11/22/2024 12:10:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d2
11/22/2024 12:10:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d3
11/22/2024 12:10:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d4
11/22/2024 12:10:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d5
11/22/2024 12:10:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d6
11/22/2024 12:10:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7811fb139cb87e09d7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0c11fb139cb87dfa8b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f1
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f3
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f5
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08f8
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08fa
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08fb
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08fc
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08fd
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08fe
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e08ff
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0900
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0901
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0902
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0903
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0904
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0905
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0906
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0907
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0908
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e0909
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e090a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e090b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e090c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e090d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7711fb139cb87e090e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e090f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0910
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0911
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0912
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0913
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0914
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0915
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0916
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0917
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0918
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0919
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e091f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0920
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0921
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0922
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0923
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0924
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0925
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0926
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0927
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0928
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0929
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e092f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0930
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0931
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0932
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0933
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0934
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0935
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0936
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0937
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0938
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0939
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e093f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0940
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0941
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0942
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0943
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0944
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0945
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0946
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0947
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0948
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0949
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e094f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0950
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0951
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0952
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0953
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0954
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0955
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0956
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0957
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0958
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0959
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e095f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0960
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0961
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0962
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0963
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0964
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0965
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0966
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0967
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0968
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0969
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e096f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0970
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0971
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0972
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0973
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0974
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0975
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0976
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0977
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0978
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0979
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e097f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0980
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0981
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0982
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0983
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0984
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0985
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0986
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0987
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0988
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0989
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e098f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0990
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0991
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0992
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0993
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0994
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0995
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0996
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0997
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0998
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e0999
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099a
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099b
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099c
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099d
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099e
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e099f
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a0
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a1
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a2
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a3
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a4
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a5
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a6
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a8
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09a9
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09aa
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ab
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ac
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ad
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ae
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09af
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b0
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b1
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b2
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b3
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b4
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b5
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b6
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b8
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09b9
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ba
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09bb
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09bc
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09bd
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09be
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09bf
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c0
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c1
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c2
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c3
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c4
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c5
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c6
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c8
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09c9
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ca
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09cb
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09cc
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09cd
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09ce
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09cf
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d0
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d1
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d2
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d3
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d4
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d5
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d6
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d7
11/22/2024 12:10:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7811fb139cb87e09d8
11/22/2024 12:10:55 PM UTC [INFO] Received an event for node: 67406d0f11fb139cb87dfaab
11/22/2024 12:12:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efb309242613e1ac3bae49c386146dde02a4d8c8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0f11fb139cb87dfaab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:efb309242613e1ac3bae49c386146dde02a4d8c8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0f11fb139cb87dfaab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7fe811f59581b227fc7e067a3ed7301ad959d537', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7fe811f59581b227fc7e067a3ed7301ad959d537', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8f0a490d0870aafcea2e731680bf11bb35159cf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f0a490d0870aafcea2e731680bf11bb35159cf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4283bcfb3f6684b26861f54647b3293d3e4930d8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4283bcfb3f6684b26861f54647b3293d3e4930d8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2f80faa24976b827173866977aa0d12e01971e2c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f80faa24976b827173866977aa0d12e01971e2c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:531377ef5d9f5f0badfc415387a2d1b17877b86f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:531377ef5d9f5f0badfc415387a2d1b17877b86f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:687226daf9d719ed50496a3d4ee9b330c0cf9bc4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:687226daf9d719ed50496a3d4ee9b330c0cf9bc4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:593aaaeb186fe508d1d7fed510be80b181dc4b5b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:593aaaeb186fe508d1d7fed510be80b181dc4b5b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95d716dff3de632fc1affb2074e5b1c6a2525ca9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95d716dff3de632fc1affb2074e5b1c6a2525ca9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:89aab11f210932923ac5ebd35add991b0738fd31', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:89aab11f210932923ac5ebd35add991b0738fd31', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:66bbfd5df8ab6da5bb8716fb9dbbe7e04525cb80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66bbfd5df8ab6da5bb8716fb9dbbe7e04525cb80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:86916989bd9598fa1634f9631da448a53c5b219f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:86916989bd9598fa1634f9631da448a53c5b219f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:13b71b880c07f239e1c72231c6e6a9a18881537e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:13b71b880c07f239e1c72231c6e6a9a18881537e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bb67844cdd9606242568b351de6a35c48dd28e0c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bb67844cdd9606242568b351de6a35c48dd28e0c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:665dc560fc23f7b2d0339168fcf0036719f204d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:665dc560fc23f7b2d0339168fcf0036719f204d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7a6fd608074eabca226efffa8f48431c4911b4a8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a6fd608074eabca226efffa8f48431c4911b4a8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b40179a0850d1bdddb1c9bbabc4d475cab0828e0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b40179a0850d1bdddb1c9bbabc4d475cab0828e0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:126f3a2d2aed76bc93094b757439c45463618622', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:126f3a2d2aed76bc93094b757439c45463618622', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:504edb7289359c8a0f58590303a0fd76594896fd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:504edb7289359c8a0f58590303a0fd76594896fd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:42914c633a4de642a4bef70a02a20a6e955f0e4f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:42914c633a4de642a4bef70a02a20a6e955f0e4f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:36b04910e333b9be26907559565e26c434c89ff2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:36b04910e333b9be26907559565e26c434c89ff2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:24d7181743a7d54497e6aa50a323359b2d8d2f68', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:24d7181743a7d54497e6aa50a323359b2d8d2f68', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2880cd3d7ff0460ad6f636712731b8d90a39249f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2880cd3d7ff0460ad6f636712731b8d90a39249f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:01ba306b773f12c14bb9a6b6dfc5db2af0cbf836', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:01ba306b773f12c14bb9a6b6dfc5db2af0cbf836', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b6d4a603ff6c52525f58dd2caab384bca714994c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b6d4a603ff6c52525f58dd2caab384bca714994c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a7989f89ebc13713b921a4198a90ce7dd7f8d71c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a7989f89ebc13713b921a4198a90ce7dd7f8d71c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e09ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:11411bc9239d0c0e340590de04b52c5ce52df532', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:11411bc9239d0c0e340590de04b52c5ce52df532', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d8473182bde5a4d232cc6dcce79eca245cfefe6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8473182bde5a4d232cc6dcce79eca245cfefe6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b057271ed98b4bdfc02fea6c9f3d2add8fc716ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b057271ed98b4bdfc02fea6c9f3d2add8fc716ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f9f9e77cac85d0b89441811dfe556b8aa55224e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f9f9e77cac85d0b89441811dfe556b8aa55224e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4bebae22b0d240ef864d411eef92a119699d896e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4bebae22b0d240ef864d411eef92a119699d896e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:12:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3c6946b83d85afd6984c58cee0fe5c37cf7932c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3c6946b83d85afd6984c58cee0fe5c37cf7932c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5c9e21020056276877461fa7410eed689e9e46b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5c9e21020056276877461fa7410eed689e9e46b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:215958e62ab5a4b4bb9b82ed598032a7be8c9e60', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:215958e62ab5a4b4bb9b82ed598032a7be8c9e60', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:96c217d9e364c8db6c3c3342beed52b79b409a32', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:96c217d9e364c8db6c3c3342beed52b79b409a32', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:01d15e7bb49ed42cbde487f7188cbbf9323cc5c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:01d15e7bb49ed42cbde487f7188cbbf9323cc5c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a54b2250fe2cb94f53aea62d40940c683735361d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a54b2250fe2cb94f53aea62d40940c683735361d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:954ba609145432e86bd72d0464341cf0984dbbcd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:954ba609145432e86bd72d0464341cf0984dbbcd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:adb9f77e3ccef0529b0364765cbcc8e534ab1ae7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:adb9f77e3ccef0529b0364765cbcc8e534ab1ae7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:44d736d6d27531702594ba798c153e0dd53a7968', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:44d736d6d27531702594ba798c153e0dd53a7968', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1677f339d20ffab7bb1ff17722bbb7dd9060e8b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1677f339d20ffab7bb1ff17722bbb7dd9060e8b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:349d630ba053b75b5c9db70eaaa50a7c6f0461e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:349d630ba053b75b5c9db70eaaa50a7c6f0461e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:de49d04b42164b64c86d5c5bff6cb853d0a3fae4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de49d04b42164b64c86d5c5bff6cb853d0a3fae4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:93f2f67a4c2303578b6a72e295df202d1cd4aa0b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93f2f67a4c2303578b6a72e295df202d1cd4aa0b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8808bced6a59713a1cb744e5bf7e79694a86c35b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8808bced6a59713a1cb744e5bf7e79694a86c35b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b617f23177fc2f2f943abc128c874819ec9b1b58', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b617f23177fc2f2f943abc128c874819ec9b1b58', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1a6a9b3f150987997f833479a5e3e128cecbc31d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a6a9b3f150987997f833479a5e3e128cecbc31d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:77e49a326002c426405edd83266a2627e2eae7fd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:77e49a326002c426405edd83266a2627e2eae7fd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2a09d707f1524f67f233d2b1e0d43d8780080dab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a09d707f1524f67f233d2b1e0d43d8780080dab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c37576cec4a30f5d761a8ff29f112691003fe18f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c37576cec4a30f5d761a8ff29f112691003fe18f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8a962953c51ec55adec141c76d583e8e2ddfcd57', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8a962953c51ec55adec141c76d583e8e2ddfcd57', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9497ebd49e8ff26d02ecd7677ae83973d25323f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9497ebd49e8ff26d02ecd7677ae83973d25323f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:244f68f559b213d61ff4792bfd231e07767811c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:244f68f559b213d61ff4792bfd231e07767811c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:67dc31efe630f01d02c31cd9479d096ee172544d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:67dc31efe630f01d02c31cd9479d096ee172544d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:55aff0e4686f41852a655c4b17c225a0b7ee485c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:55aff0e4686f41852a655c4b17c225a0b7ee485c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2f042d99c8edc7e84a4ec1d51a654f792ec9bccc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f042d99c8edc7e84a4ec1d51a654f792ec9bccc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c5ba23530c7da126f59035b157e74033c4757ba0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c5ba23530c7da126f59035b157e74033c4757ba0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0310dd48845a3a0953de6da0fda70f9e5e1119aa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0310dd48845a3a0953de6da0fda70f9e5e1119aa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f5be383d3ec3d9082a7b96e312f4ddf0339a7d7a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f5be383d3ec3d9082a7b96e312f4ddf0339a7d7a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3d338438545d23c56804f53ad25fc6a3b53abe47', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3d338438545d23c56804f53ad25fc6a3b53abe47', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9b74fe9b4180cf28fc4abbd237d7d96c360b120b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b74fe9b4180cf28fc4abbd237d7d96c360b120b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:72ada1099e6dce74f8bbe7a85757961d66cc5c8b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72ada1099e6dce74f8bbe7a85757961d66cc5c8b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d268ca1ef12a1d93b27ccca35836a6a476aad534', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d268ca1ef12a1d93b27ccca35836a6a476aad534', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0007d5258827c7d5eccb0b1e71c29b8bf6335cf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0007d5258827c7d5eccb0b1e71c29b8bf6335cf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9cd5eea74eaf02ce106a7fff3098534f64d9e681', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9cd5eea74eaf02ce106a7fff3098534f64d9e681', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f38c5f768ffaab47633e978994e61e36d3fcb4ac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f38c5f768ffaab47633e978994e61e36d3fcb4ac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0573deeea77e7c4259d2f2089de97582c54895b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0573deeea77e7c4259d2f2089de97582c54895b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fe9a967ef6749c576d1d52c77043780d547ff574', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fe9a967ef6749c576d1d52c77043780d547ff574', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:88473bb831cd6f4569155df11efc8789bf619b39', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:88473bb831cd6f4569155df11efc8789bf619b39', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0daf4b116746ffe9ee0cc33ded3199cb7fa533bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0daf4b116746ffe9ee0cc33ded3199cb7fa533bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ac3aaa7f4e1b7f666ff5af498cb090409a3cd3b5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac3aaa7f4e1b7f666ff5af498cb090409a3cd3b5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:99a9961b4eab4f85dbb642bff7522a6d32e25ee9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:99a9961b4eab4f85dbb642bff7522a6d32e25ee9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e88c1ea57bf79ece46c833a771afb90047cacf53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e88c1ea57bf79ece46c833a771afb90047cacf53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3e0c1e7260958bb37345fe38e54fc7c9d49b69bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3e0c1e7260958bb37345fe38e54fc7c9d49b69bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a58a840eb58d1f7cda767a6147922e6c52c38ecc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a58a840eb58d1f7cda767a6147922e6c52c38ecc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ebd365e2b298274b2284834bc6b2179bc67fe247', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ebd365e2b298274b2284834bc6b2179bc67fe247', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c021f05574670a7a266e5d2d78a05c9057bbcdf0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c021f05574670a7a266e5d2d78a05c9057bbcdf0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:84f106cb4b3505057e314ead3d398ce797f6aa24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:84f106cb4b3505057e314ead3d398ce797f6aa24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9faa143e83514defe13e1b0280b6c504be9e214c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9faa143e83514defe13e1b0280b6c504be9e214c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a779aa8c334cc5d5624bad7037f9f247f23fcf6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a779aa8c334cc5d5624bad7037f9f247f23fcf6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:04afdc895bedab2bd5f303ccb1b13d365968d265', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:04afdc895bedab2bd5f303ccb1b13d365968d265', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8f289bd8e744cb9b88c8f3c8b9216ae60403fb01', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f289bd8e744cb9b88c8f3c8b9216ae60403fb01', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:57dbf9b87486ea416637c3a0bf36733ef26066d1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57dbf9b87486ea416637c3a0bf36733ef26066d1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e8f61f1c89fc0a03883258136efe23c7952932a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e8f61f1c89fc0a03883258136efe23c7952932a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fda3d9b52997cae2e04211a06f7e869631a09bd4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fda3d9b52997cae2e04211a06f7e869631a09bd4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7911fb139cb87e0a3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b242d8f484b2ef600d6e6e7300f37c9f24383a79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b242d8f484b2ef600d6e6e7300f37c9f24383a79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ca21c95d97733a61795db55b0879304985d7ad4e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca21c95d97733a61795db55b0879304985d7ad4e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3122a8cf090ef9266708d5484d888bfd117ad3da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3122a8cf090ef9266708d5484d888bfd117ad3da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:60dbdebebb5fa8b990b38dafe75e5ba3987b87e3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:60dbdebebb5fa8b990b38dafe75e5ba3987b87e3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:52173993b77d69b84592caf1441e1d01e8232c33', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52173993b77d69b84592caf1441e1d01e8232c33', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:58ab27ed262159fec22947ef30966d5463364634', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:58ab27ed262159fec22947ef30966d5463364634', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2fbb18a5146a134e7a919e294ef78f03be395483', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2fbb18a5146a134e7a919e294ef78f03be395483', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e5a99893c6c5b20ae09b54dbcbce7a6f5902234f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e5a99893c6c5b20ae09b54dbcbce7a6f5902234f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fd3be8cc4c4d1f9a77dbd991848d9cb52d2ac9d6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd3be8cc4c4d1f9a77dbd991848d9cb52d2ac9d6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:82bf46eba8152442504057550f710c4cc6223545', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:82bf46eba8152442504057550f710c4cc6223545', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:801c5fb168f6b3fe7597190b21d508aad34814b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:801c5fb168f6b3fe7597190b21d508aad34814b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:112b171160760c074b5028c683aa8baddd2df9ac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:112b171160760c074b5028c683aa8baddd2df9ac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bb5a0ad217d5d21519e766f89e14b0daec1052a0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bb5a0ad217d5d21519e766f89e14b0daec1052a0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:897a498f630693ba5a52cd7136fb0f786591eded', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:897a498f630693ba5a52cd7136fb0f786591eded', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:40e0c343ba6aaca62f395798181909b395c9315a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:40e0c343ba6aaca62f395798181909b395c9315a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5aa800fe1a5720afa900e4894f8ac32e15b2c5d7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5aa800fe1a5720afa900e4894f8ac32e15b2c5d7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dbed1bc4864d3cf9ad1b0b166b0d774bb90c0869', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dbed1bc4864d3cf9ad1b0b166b0d774bb90c0869', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:674609445ef8c700a2a7b844321184f0b86e6106', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:674609445ef8c700a2a7b844321184f0b86e6106', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b5b6a5bb42946ccfa2f627079651e96fd00d1a24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b5b6a5bb42946ccfa2f627079651e96fd00d1a24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5a47f70c22a0917162a6c138797cea71b2230d64', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a47f70c22a0917162a6c138797cea71b2230d64', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5eabfa9943028d2ce6134f1ebecfeda1e4d04ad8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5eabfa9943028d2ce6134f1ebecfeda1e4d04ad8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:74651cbc952ce73af8e3a4bdf393a6f8db66a0bd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:74651cbc952ce73af8e3a4bdf393a6f8db66a0bd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:85f3a0e0ec8f6f6dc62d777f00067c57ea49c2e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:85f3a0e0ec8f6f6dc62d777f00067c57ea49c2e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:47e83d37ca0e0f9367379a1abd909344a446ad9d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47e83d37ca0e0f9367379a1abd909344a446ad9d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:460496d383485d00111173d821b337e36587349f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:460496d383485d00111173d821b337e36587349f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:144d18b59ba4d8f702354498648ca86de89befa0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:144d18b59ba4d8f702354498648ca86de89befa0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:358ea6339082db65ce8c01d2bb0dd9fdf072426f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:358ea6339082db65ce8c01d2bb0dd9fdf072426f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c15a39bccd18c4aa1240e38e2fd8cda0faad8f40', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c15a39bccd18c4aa1240e38e2fd8cda0faad8f40', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1b7b2d9044f70d761daf8276acee7b6d18d9c9d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1b7b2d9044f70d761daf8276acee7b6d18d9c9d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df10346e4b4dad86a2b808c9764160f07a41e71d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df10346e4b4dad86a2b808c9764160f07a41e71d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d651593cc660b96cbc96c835c3aa24cf64b94ea3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d651593cc660b96cbc96c835c3aa24cf64b94ea3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f64aeac5413e7fd87ef791059af6519c834a4f86', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f64aeac5413e7fd87ef791059af6519c834a4f86', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:61a2da6b555893b162947e8de40ce37dc5a58e14', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:61a2da6b555893b162947e8de40ce37dc5a58e14', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ac319660f81e5177cfbe614de38a8dc4ad78ba07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac319660f81e5177cfbe614de38a8dc4ad78ba07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:269092b0c9d4054335a3298c694455e6bdcb873e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:269092b0c9d4054335a3298c694455e6bdcb873e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1b987c966576d82cd74fecdfe609911a4c6b5dea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1b987c966576d82cd74fecdfe609911a4c6b5dea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a67d83e13bd6a83706909b8560df91bbbafe47c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a67d83e13bd6a83706909b8560df91bbbafe47c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d37a7ecb1c4b568bd84767dce65f6ae30fcf7cfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d37a7ecb1c4b568bd84767dce65f6ae30fcf7cfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dfa96bdc7d1c37cba266107122edb6b980e2c3f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dfa96bdc7d1c37cba266107122edb6b980e2c3f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:52d005777194eaa4777a64ec7f4c69e68b2c8fe6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d005777194eaa4777a64ec7f4c69e68b2c8fe6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ca5d43b192e93375450af2e18b3eb4a1527bf6ae', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca5d43b192e93375450af2e18b3eb4a1527bf6ae', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e88422a19d36528e9e9569a9fbbc2000077426a0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e88422a19d36528e9e9569a9fbbc2000077426a0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:82eb09a463b138daac463604b9c69bceb491d1d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:82eb09a463b138daac463604b9c69bceb491d1d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1936f774cdc3981a2924be88d09e37b7afe3ce1f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1936f774cdc3981a2924be88d09e37b7afe3ce1f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:69780bd8eea9a3ddea6415dfc1408e512adfcacb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:69780bd8eea9a3ddea6415dfc1408e512adfcacb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:48b8bdbd5e307a3d7aa3b6bb5ffc710a7ff8bb10', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:48b8bdbd5e307a3d7aa3b6bb5ffc710a7ff8bb10', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9d2dceed22cb597ba72fa2098585912b1bad61af', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9d2dceed22cb597ba72fa2098585912b1bad61af', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f54c2456d8551e2ee62c7e0d3ca1c69c148b8055', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f54c2456d8551e2ee62c7e0d3ca1c69c148b8055', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:66526d18ffb34479988aba54dbb39172e378fec2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66526d18ffb34479988aba54dbb39172e378fec2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6ebb9eec4ed2c13ac6f43f59ba1a16558fac7059', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ebb9eec4ed2c13ac6f43f59ba1a16558fac7059', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:57ccb785424e3e57c929fd6d9fbc7863c0dde688', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57ccb785424e3e57c929fd6d9fbc7863c0dde688', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d3f7d0967febbaad65235c0290d9ff05623930b8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d3f7d0967febbaad65235c0290d9ff05623930b8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:16b0fc842f33953c18a5885bbc956cc438c12ede', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:16b0fc842f33953c18a5885bbc956cc438c12ede', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:147e02153bcd5b87a1df235245de242f647a23f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:147e02153bcd5b87a1df235245de242f647a23f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:147ab58444a288c30ea58c2fc4a30021ad766e7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:147ab58444a288c30ea58c2fc4a30021ad766e7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c33a7a0b362a5252019240f432934ebba60f64f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c33a7a0b362a5252019240f432934ebba60f64f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:840de7ca6fe2bc9661be28dc318128a19b730351', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:840de7ca6fe2bc9661be28dc318128a19b730351', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:14753a5195c270b99138a251009c4c97d7551747', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:14753a5195c270b99138a251009c4c97d7551747', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8290517122f13981bd39126a7e17a1b0b890c1b8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8290517122f13981bd39126a7e17a1b0b890c1b8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8232006400ad7afeac3f99d5fedbcf279737f57d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8232006400ad7afeac3f99d5fedbcf279737f57d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e579b4796db5b3f699487f9a3f13e31003ee028', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e579b4796db5b3f699487f9a3f13e31003ee028', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:639bfe418326fb59d714bccee6ec705c7a86fa6b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:639bfe418326fb59d714bccee6ec705c7a86fa6b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:78cd3b238d446f0e74d44e3632ae34f82949dbf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:78cd3b238d446f0e74d44e3632ae34f82949dbf6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4f0871475ca9340d7c90d7cd7ab17a6391794eed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4f0871475ca9340d7c90d7cd7ab17a6391794eed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d22c1e0a6ff45a92419e61d0f306ab872c7d85c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d22c1e0a6ff45a92419e61d0f306ab872c7d85c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dec95c83f6eec5afba005117f8f46b2adcb3215c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dec95c83f6eec5afba005117f8f46b2adcb3215c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:18065e2712d8bbafe92ac479e0aba6b0fdf2aa3c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18065e2712d8bbafe92ac479e0aba6b0fdf2aa3c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f4b199855b661ed046dd5dc77d381df8f5390235', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f4b199855b661ed046dd5dc77d381df8f5390235', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d5a5fe20d5b8556df4bf40f56293878173579d96', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d5a5fe20d5b8556df4bf40f56293878173579d96', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9b161daca219e2070157a1bc010bb166b2d6728d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b161daca219e2070157a1bc010bb166b2d6728d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4c16879829c5de5c78ab26e844ac9103838b4eb1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c16879829c5de5c78ab26e844ac9103838b4eb1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:54ccd95125e0d985c28c3547705dbf1e1d37f53e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:54ccd95125e0d985c28c3547705dbf1e1d37f53e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2fb9f96e295cd1ea2d14c19e1bb9429daf712063', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2fb9f96e295cd1ea2d14c19e1bb9429daf712063', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df0aac51625f9def1e8ab9f14e7c2d69693f3079', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df0aac51625f9def1e8ab9f14e7c2d69693f3079', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efe93442eb5ac748361c3a45b5c4a0955e4c21e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:efe93442eb5ac748361c3a45b5c4a0955e4c21e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b03bac39c84e3c8c3c7ea71ec4ee7eae2f8f9dc8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b03bac39c84e3c8c3c7ea71ec4ee7eae2f8f9dc8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b85c17c58d0e0c9dfb81cec58956baf2dee17ea2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b85c17c58d0e0c9dfb81cec58956baf2dee17ea2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:743acc7638abfed631117a6101364e1b4f9cfff8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:743acc7638abfed631117a6101364e1b4f9cfff8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e3e3fcb076ce7b100a8f407c3d7c74079069a2f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e3e3fcb076ce7b100a8f407c3d7c74079069a2f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6c2f121a36baa32c285a5896628b9c62501cb338', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c2f121a36baa32c285a5896628b9c62501cb338', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:21926c26a7aa9e95abd908c064acc9f916187a3f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:21926c26a7aa9e95abd908c064acc9f916187a3f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8069f93b84e0d45176084ebed3bb0a080bb4b38c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8069f93b84e0d45176084ebed3bb0a080bb4b38c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:eec060d78861f7eeef79060c00ef791725678bcf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eec060d78861f7eeef79060c00ef791725678bcf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2f6272ac0bafae22e60979e5aec353eac4b07196', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f6272ac0bafae22e60979e5aec353eac4b07196', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:67242d5fe37fb1ad53770fe2d9fb31f1aad05c80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:67242d5fe37fb1ad53770fe2d9fb31f1aad05c80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bc2a0891600c928ef14d0e21da720df86e599162', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bc2a0891600c928ef14d0e21da720df86e599162', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1e57745fa14639f8202ce8ba98d7b4c7fb0d77d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1e57745fa14639f8202ce8ba98d7b4c7fb0d77d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f7439d966185ce87bd20d984d2c1f5a070463c30', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f7439d966185ce87bd20d984d2c1f5a070463c30', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:165e63165667c1c0470df4cf6f948e31dfec4dc9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:165e63165667c1c0470df4cf6f948e31dfec4dc9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4c981911b4b0254afe0e36d6bd21077bbe14e57d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c981911b4b0254afe0e36d6bd21077bbe14e57d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:22fa97810d2f22a9034262c883d25746334bef43', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:22fa97810d2f22a9034262c883d25746334bef43', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8c96d972916f9615b2a4fa67ce9638d8e14ffac4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8c96d972916f9615b2a4fa67ce9638d8e14ffac4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:634f259df74fa60f783d05f789da933c33ea966b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:634f259df74fa60f783d05f789da933c33ea966b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2bac73abaa0fedfb2b80a7ec7e905e893f519586', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2bac73abaa0fedfb2b80a7ec7e905e893f519586', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b0da445cef616842b477b03e0648d043d790a82', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0b0da445cef616842b477b03e0648d043d790a82', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:59fa24e62a3fab8caba66d592bfb18e3afefb323', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59fa24e62a3fab8caba66d592bfb18e3afefb323', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f44d642ea616428c6e2ecdfd725838063fab9257', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f44d642ea616428c6e2ecdfd725838063fab9257', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e8da354dfbaf5a4de4e79e8df2f0384730f4c8f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e8da354dfbaf5a4de4e79e8df2f0384730f4c8f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a46c4e2bb404447d3b3e98c3327d37d05a55895', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a46c4e2bb404447d3b3e98c3327d37d05a55895', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6467b7bc5e706331a5ca7bebf6f01cf43be63104', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6467b7bc5e706331a5ca7bebf6f01cf43be63104', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b15f6bf37ddcc403b0263eab3dd9cd0424a5efad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b15f6bf37ddcc403b0263eab3dd9cd0424a5efad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3e7937bdeee218cfa2469ebf1697e51a1bf2b180', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3e7937bdeee218cfa2469ebf1697e51a1bf2b180', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e2be7fff6991b4ad06696b58ccdcf0eae9085a53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e2be7fff6991b4ad06696b58ccdcf0eae9085a53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:93c65f792072396ba81adbb866ac3bbb8ce3adb6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93c65f792072396ba81adbb866ac3bbb8ce3adb6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:72d5535229c842f51d64c4b1440a07323d7b9ef8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72d5535229c842f51d64c4b1440a07323d7b9ef8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dfb147574cd1fe654733cc12c7d122058572e7e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dfb147574cd1fe654733cc12c7d122058572e7e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e5e13c55ce21ec68b4e58459907cc9c6f3b8a0b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e5e13c55ce21ec68b4e58459907cc9c6f3b8a0b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e8ce63583d582365d0e47a1c202bfbeb440a32e6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e8ce63583d582365d0e47a1c202bfbeb440a32e6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4670748cf1fd90c5c2db335a421439b86df9ea91', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4670748cf1fd90c5c2db335a421439b86df9ea91', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c9918ea5851a45c7cd6e4ed6f0f50de5c5266b0d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c9918ea5851a45c7cd6e4ed6f0f50de5c5266b0d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:98eb55fa4bf42e951da4bb8d6e7adfb240be8537', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:98eb55fa4bf42e951da4bb8d6e7adfb240be8537', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aa9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:219c3e9a91ca6736d870c63e62652c5e4fa795cc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aaa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:219c3e9a91ca6736d870c63e62652c5e4fa795cc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aaa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:757650f20f601a8ba81a3bac84dc33742576fc92', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:757650f20f601a8ba81a3bac84dc33742576fc92', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:522e0a6fbff6f3e4e432d45c59c5bf42afe7cd0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:522e0a6fbff6f3e4e432d45c59c5bf42afe7cd0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b3b269910984814d0b960d824eb4a7412dff854c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b3b269910984814d0b960d824eb4a7412dff854c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4d5ae9cc72441eeafe39a8c6583be112eef2373e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d5ae9cc72441eeafe39a8c6583be112eef2373e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d8783271998349602232049e42276d455685fdbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8783271998349602232049e42276d455685fdbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a283201f374b6602c8cbcfcc8972bdae80cf0a66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a283201f374b6602c8cbcfcc8972bdae80cf0a66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:11b97730143fb47a7b1b4cbd179594664e19c726', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:11b97730143fb47a7b1b4cbd179594664e19c726', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:46cc434c6144593864ee53f51a795e8beb3272b1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:46cc434c6144593864ee53f51a795e8beb3272b1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:79d7b2f3e597ed546673ddac4a415f36b0562d0a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:79d7b2f3e597ed546673ddac4a415f36b0562d0a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4862eca693a28dc4c401962ef4711d22b9516ba2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4862eca693a28dc4c401962ef4711d22b9516ba2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4533de3a7b2f7ca04d79df0f01f9e0a23efa3944', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4533de3a7b2f7ca04d79df0f01f9e0a23efa3944', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4f84c4e62d1a49485bba9288605641a45631c816', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4f84c4e62d1a49485bba9288605641a45631c816', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:463545ff5b35ee854242c0d3cd6cf928e6073992', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:463545ff5b35ee854242c0d3cd6cf928e6073992', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8024f419db8e9592aa072c5e5c75a5f5cab4a30d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8024f419db8e9592aa072c5e5c75a5f5cab4a30d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f0e08035d61343a83a0d26b9707d1c481228c718', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f0e08035d61343a83a0d26b9707d1c481228c718', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ab9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:55590fdd193d846d138a4902dbd2748b1e479b86', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:55590fdd193d846d138a4902dbd2748b1e479b86', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0aba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0a7d4ca6759dc2437b9bf2bbdcb004845c8d0ff9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0a7d4ca6759dc2437b9bf2bbdcb004845c8d0ff9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d9cdce57a4e0ffd57c777b5e400e072d3ec5ef5b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9cdce57a4e0ffd57c777b5e400e072d3ec5ef5b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df6455eb53f00f6fc854034ec5eca1bbe1fd90f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df6455eb53f00f6fc854034ec5eca1bbe1fd90f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e440c2ba17e8673972891a14a662eb039457a2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e440c2ba17e8673972891a14a662eb039457a2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:34c9c44261262e14a22e7e25ab4fee8cfd01f872', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34c9c44261262e14a22e7e25ab4fee8cfd01f872', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0abf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.425179] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.433101] Modules linked in:\n[    4.436158] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.443896] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.453370] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.457819] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.476566] RSP: 0018:ffffad08c0033b30 EFLAGS: 00010246\n[    4.481793] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    4.488923] RDX: ffffad08c0033b38 RSI: 0000000000000001 RDI: ffffad08c0033b80\n[    4.496054] RBP: ffffa23a441388e8 R08: ffffa23a4412f6f0 R09: ffffa23a41bb3000\n[    4.503185] R10: 0000000000000040 R11: ffffffff99658840 R12: ffffa23a44100000\n[    4.510315] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.517447] FS:  0000000000000000(0000) GS:ffffa23b66e00000(0000) knlGS:0000000000000000\n[    4.525532] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.531279] CR2: ffffa23b6f1ff000 CR3: 00000000b082e000 CR4: 00000000003506f0\n[    4.538411] Call Trace:\n[    4.540861]  <TASK>\n[    4.542965]  ? __warn+0x84/0x130\n[    4.546200]  ? __flush_work+0x2d6/0x300\n[    4.550039]  ? report_bug+0x164/0x190\n[    4.553709]  ? handle_bug+0x54/0x90\n[    4.557203]  ? exc_invalid_op+0x17/0x70\n[    4.561040]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.565233]  ? __flush_work+0x2d6/0x300\n[    4.569079]  cancel_delayed_work_sync+0x5c/0x80\n[    4.573614]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.578150]  amdgpu_ring_alloc+0x3e/0x60\n[    4.582079]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.587218]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.591662]  amdgpu_device_init+0x1e4f/0x2530\n[    4.596024]  amdgpu_driver_load_kms+0x14/0x80\n[    4.600386]  amdgpu_pci_probe+0x150/0x490\n[    4.604401]  local_pci_probe+0x3d/0x90\n[    4.608158]  pci_device_probe+0xb5/0x180\n[    4.612087]  really_probe+0xcc/0x2b0\n[    4.615666]  ? __pfx___driver_attach+0x10/0x10\n[    4.620111]  __driver_probe_device+0x6e/0x110\n[    4.624470]  driver_probe_device+0x1a/0xe0\n[    4.628569]  __driver_attach+0x83/0x180\n[    4.632411]  bus_for_each_dev+0x83/0xd0\n[    4.636252]  bus_add_driver+0xe3/0x210\n[    4.640006]  driver_register+0x54/0x100\n[    4.643845]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.647948]  do_one_initcall+0x56/0x220\n[    4.651790]  kernel_init_freeable+0x19e/0x2d0\n[    4.656154]  ? __pfx_kernel_init+0x10/0x10\n[    4.660262]  kernel_init+0x15/0x1c0\n[    4.663752]  ret_from_fork+0x2f/0x50\n[    4.667331]  ? __pfx_kernel_init+0x10/0x10\n[    4.671430]  ret_from_fork_asm+0x1a/0x30\n[    4.675359]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.852171] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.860179] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt btusb snd_sof_amd_renoir uvcvideo btrtl snd_sof_amd_acp snd_acp_config btintel videobuf2_vmalloc btbcm snd_sof_pci snd_soc_acp_rt5682_mach rtw88_8822ce snd_sof_xtensa_dsp videobuf2_memops btmtk bluetooth cros_ec_chardev cros_ec_debugfs cros_ec_hwmon cros_usbpd_charger cros_ec_sysfs cros_charge_control cros_usbpd_logger snd_soc_rt5682_i2c sp5100_tco rtw88_8822c uvc snd_soc_acp_da7219mx98357_mach memconsole_coreboot videobuf2_v4l2 snd_soc_rt5682 acpi_als snd_soc_rl6231 industrialio_triggered_buffer snd_sof regmap_i2c snd_sof_utils rtw88_pci snd_soc_acpi watchdog cros_ec_typec gsmi videobuf2_common snd_soc_max98357a roles kfifo_buf snd_soc_cros_ec_codec cros_ec_dev i2c_piix4 snd_pci_acp3x rtw88_core acp_audio_dma cros_usbpd_notify typec industrialio i2c_cros_ec_tunnel vpd_sysfs memconsole snd_soc_core elan_i2c snd_compress snd_pcm_dmaengine chromeos_pstore coreboot_table\n[    6.944402] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.953881] Tainted: [W]=WARN\n[    6.956853] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    6.966327] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.972773] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.977223] Code: 70 9e f7 69 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.995976] RSP: 0018:ffffad08c01b7c70 EFLAGS: 00010246\n[    7.001203] RAX: 0000000000000000 RBX: ffffa23a441388e8 RCX: 0000000000000000\n[    7.008341] RDX: ffffad08c01b7c78 RSI: 0000000000000001 RDI: ffffad08c01b7cc0\n[    7.015478] RBP: ffffa23a441388e8 R08: ffffad08c01b7df0 R09: 0000000000000000\n[    7.022613] R10: ffffad08c01b7b38 R11: fffffffffffc75fe R12: 00000000000003e8\n[    7.029749] R13: 0000000000000001 R14: ffffa23a44100000 R15: ffffa23a441323c0\n[    7.036884] FS:  0000000000000000(0000) GS:ffffa23b66e80000(0000) knlGS:0000000000000000\n[    7.044974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.050722] CR2: 00007effbde42a1c CR3: 0000000100924000 CR4: 00000000003506f0\n[    7.057857] Call Trace:\n[    7.060309]  <TASK>\n[    7.062415]  ? __warn+0x84/0x130\n[    7.065653]  ? __flush_work+0x2d6/0x300\n[    7.069495]  ? report_bug+0x164/0x190\n[    7.073170]  ? handle_bug+0x54/0x90\n[    7.076665]  ? exc_invalid_op+0x17/0x70\n[    7.080504]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.084701]  ? __flush_work+0x2d6/0x300\n[    7.088544]  cancel_delayed_work_sync+0x5c/0x80\n[    7.093081]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.097621]  amdgpu_ring_alloc+0x3e/0x60\n[    7.101550]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.105659]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.110196]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.115167]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.119529]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.125360]  process_one_work+0x163/0x390\n[    7.129378]  worker_thread+0x2a0/0x3b0\n[    7.133136]  ? __pfx_worker_thread+0x10/0x10\n[    7.137411]  ? __pfx_worker_thread+0x10/0x10\n[    7.141683]  kthread+0xcb/0xf0\n[    7.144745]  ? __pfx_kthread+0x10/0x10\n[    7.148502]  ret_from_fork+0x2f/0x50\n[    7.152087]  ? __pfx_kthread+0x10/0x10\n[    7.155846]  ret_from_fork_asm+0x1a/0x30\n[    7.159776]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:85c134fcbfed470e5001855bb64c20d9d0de7667', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ac0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:85c134fcbfed470e5001855bb64c20d9d0de7667', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7a11fb139cb87e0ac0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaab
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09de
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09df
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09e9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ea
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09eb
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ec
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ed
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ee
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ef
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09fa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09fb
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09fc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09fd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09fe
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e09ff
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a00
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a01
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a02
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a03
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a04
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a05
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a06
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a07
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a08
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a09
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a0f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a10
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a11
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a12
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a13
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a14
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a15
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a16
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a17
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a18
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a19
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a1f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a20
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a21
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a22
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a23
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a24
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a25
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a26
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a27
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a28
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a29
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a2f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a30
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a31
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a32
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a33
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a34
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a35
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a36
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a37
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a38
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a39
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7911fb139cb87e0a3a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a3b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a3c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a3d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a3e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a3f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a40
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a41
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a42
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a43
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a44
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a45
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a46
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a47
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a48
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a49
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a4f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a50
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a51
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a52
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a53
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a54
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a55
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a56
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a57
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a58
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a59
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a5f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a60
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a61
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a62
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a63
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a64
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a65
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a66
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a67
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a68
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a69
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a6f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a70
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a71
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a72
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a73
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a74
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a75
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a76
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a77
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a78
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a79
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a7f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a80
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a81
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a82
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a83
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a84
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a85
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a86
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a87
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a88
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a89
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a8f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a90
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a91
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a92
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a93
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a94
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a95
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a96
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a97
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a98
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a99
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0a9f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aa9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aaa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aab
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aac
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aad
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aae
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aaf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ab9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0aba
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0abb
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0abc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0abd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0abe
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0abf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ac0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7a11fb139cb87e0ac1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efb309242613e1ac3bae49c386146dde02a4d8c8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efb309242613e1ac3bae49c386146dde02a4d8c8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fe811f59581b227fc7e067a3ed7301ad959d537
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fe811f59581b227fc7e067a3ed7301ad959d537
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f0a490d0870aafcea2e731680bf11bb35159cf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f0a490d0870aafcea2e731680bf11bb35159cf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4283bcfb3f6684b26861f54647b3293d3e4930d8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4283bcfb3f6684b26861f54647b3293d3e4930d8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f80faa24976b827173866977aa0d12e01971e2c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f80faa24976b827173866977aa0d12e01971e2c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:531377ef5d9f5f0badfc415387a2d1b17877b86f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:531377ef5d9f5f0badfc415387a2d1b17877b86f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:687226daf9d719ed50496a3d4ee9b330c0cf9bc4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:687226daf9d719ed50496a3d4ee9b330c0cf9bc4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:593aaaeb186fe508d1d7fed510be80b181dc4b5b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:593aaaeb186fe508d1d7fed510be80b181dc4b5b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95d716dff3de632fc1affb2074e5b1c6a2525ca9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95d716dff3de632fc1affb2074e5b1c6a2525ca9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89aab11f210932923ac5ebd35add991b0738fd31
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89aab11f210932923ac5ebd35add991b0738fd31
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66bbfd5df8ab6da5bb8716fb9dbbe7e04525cb80
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66bbfd5df8ab6da5bb8716fb9dbbe7e04525cb80
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86916989bd9598fa1634f9631da448a53c5b219f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86916989bd9598fa1634f9631da448a53c5b219f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13b71b880c07f239e1c72231c6e6a9a18881537e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13b71b880c07f239e1c72231c6e6a9a18881537e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb67844cdd9606242568b351de6a35c48dd28e0c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb67844cdd9606242568b351de6a35c48dd28e0c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:665dc560fc23f7b2d0339168fcf0036719f204d3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:665dc560fc23f7b2d0339168fcf0036719f204d3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a6fd608074eabca226efffa8f48431c4911b4a8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a6fd608074eabca226efffa8f48431c4911b4a8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b40179a0850d1bdddb1c9bbabc4d475cab0828e0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b40179a0850d1bdddb1c9bbabc4d475cab0828e0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:126f3a2d2aed76bc93094b757439c45463618622
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:126f3a2d2aed76bc93094b757439c45463618622
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:504edb7289359c8a0f58590303a0fd76594896fd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:504edb7289359c8a0f58590303a0fd76594896fd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42914c633a4de642a4bef70a02a20a6e955f0e4f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42914c633a4de642a4bef70a02a20a6e955f0e4f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36b04910e333b9be26907559565e26c434c89ff2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36b04910e333b9be26907559565e26c434c89ff2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24d7181743a7d54497e6aa50a323359b2d8d2f68
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24d7181743a7d54497e6aa50a323359b2d8d2f68
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2880cd3d7ff0460ad6f636712731b8d90a39249f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2880cd3d7ff0460ad6f636712731b8d90a39249f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01ba306b773f12c14bb9a6b6dfc5db2af0cbf836
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01ba306b773f12c14bb9a6b6dfc5db2af0cbf836
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6d4a603ff6c52525f58dd2caab384bca714994c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6d4a603ff6c52525f58dd2caab384bca714994c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7989f89ebc13713b921a4198a90ce7dd7f8d71c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7989f89ebc13713b921a4198a90ce7dd7f8d71c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11411bc9239d0c0e340590de04b52c5ce52df532
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11411bc9239d0c0e340590de04b52c5ce52df532
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8473182bde5a4d232cc6dcce79eca245cfefe6e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8473182bde5a4d232cc6dcce79eca245cfefe6e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b057271ed98b4bdfc02fea6c9f3d2add8fc716ef
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b057271ed98b4bdfc02fea6c9f3d2add8fc716ef
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9f9e77cac85d0b89441811dfe556b8aa55224e8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9f9e77cac85d0b89441811dfe556b8aa55224e8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4bebae22b0d240ef864d411eef92a119699d896e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4bebae22b0d240ef864d411eef92a119699d896e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c6946b83d85afd6984c58cee0fe5c37cf7932c9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c6946b83d85afd6984c58cee0fe5c37cf7932c9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c9e21020056276877461fa7410eed689e9e46b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c9e21020056276877461fa7410eed689e9e46b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:215958e62ab5a4b4bb9b82ed598032a7be8c9e60
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:215958e62ab5a4b4bb9b82ed598032a7be8c9e60
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:96c217d9e364c8db6c3c3342beed52b79b409a32
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:96c217d9e364c8db6c3c3342beed52b79b409a32
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01d15e7bb49ed42cbde487f7188cbbf9323cc5c3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01d15e7bb49ed42cbde487f7188cbbf9323cc5c3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a54b2250fe2cb94f53aea62d40940c683735361d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a54b2250fe2cb94f53aea62d40940c683735361d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:954ba609145432e86bd72d0464341cf0984dbbcd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:954ba609145432e86bd72d0464341cf0984dbbcd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:adb9f77e3ccef0529b0364765cbcc8e534ab1ae7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:adb9f77e3ccef0529b0364765cbcc8e534ab1ae7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44d736d6d27531702594ba798c153e0dd53a7968
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44d736d6d27531702594ba798c153e0dd53a7968
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1677f339d20ffab7bb1ff17722bbb7dd9060e8b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1677f339d20ffab7bb1ff17722bbb7dd9060e8b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:349d630ba053b75b5c9db70eaaa50a7c6f0461e7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:349d630ba053b75b5c9db70eaaa50a7c6f0461e7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de49d04b42164b64c86d5c5bff6cb853d0a3fae4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de49d04b42164b64c86d5c5bff6cb853d0a3fae4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93f2f67a4c2303578b6a72e295df202d1cd4aa0b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93f2f67a4c2303578b6a72e295df202d1cd4aa0b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8808bced6a59713a1cb744e5bf7e79694a86c35b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8808bced6a59713a1cb744e5bf7e79694a86c35b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b617f23177fc2f2f943abc128c874819ec9b1b58
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b617f23177fc2f2f943abc128c874819ec9b1b58
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a6a9b3f150987997f833479a5e3e128cecbc31d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a6a9b3f150987997f833479a5e3e128cecbc31d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77e49a326002c426405edd83266a2627e2eae7fd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77e49a326002c426405edd83266a2627e2eae7fd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a09d707f1524f67f233d2b1e0d43d8780080dab
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a09d707f1524f67f233d2b1e0d43d8780080dab
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c37576cec4a30f5d761a8ff29f112691003fe18f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c37576cec4a30f5d761a8ff29f112691003fe18f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a962953c51ec55adec141c76d583e8e2ddfcd57
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a962953c51ec55adec141c76d583e8e2ddfcd57
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9497ebd49e8ff26d02ecd7677ae83973d25323f2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9497ebd49e8ff26d02ecd7677ae83973d25323f2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:244f68f559b213d61ff4792bfd231e07767811c3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:244f68f559b213d61ff4792bfd231e07767811c3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67dc31efe630f01d02c31cd9479d096ee172544d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67dc31efe630f01d02c31cd9479d096ee172544d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55aff0e4686f41852a655c4b17c225a0b7ee485c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55aff0e4686f41852a655c4b17c225a0b7ee485c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f042d99c8edc7e84a4ec1d51a654f792ec9bccc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f042d99c8edc7e84a4ec1d51a654f792ec9bccc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5ba23530c7da126f59035b157e74033c4757ba0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5ba23530c7da126f59035b157e74033c4757ba0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0310dd48845a3a0953de6da0fda70f9e5e1119aa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0310dd48845a3a0953de6da0fda70f9e5e1119aa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5be383d3ec3d9082a7b96e312f4ddf0339a7d7a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5be383d3ec3d9082a7b96e312f4ddf0339a7d7a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d338438545d23c56804f53ad25fc6a3b53abe47
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d338438545d23c56804f53ad25fc6a3b53abe47
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b74fe9b4180cf28fc4abbd237d7d96c360b120b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b74fe9b4180cf28fc4abbd237d7d96c360b120b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72ada1099e6dce74f8bbe7a85757961d66cc5c8b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72ada1099e6dce74f8bbe7a85757961d66cc5c8b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d268ca1ef12a1d93b27ccca35836a6a476aad534
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d268ca1ef12a1d93b27ccca35836a6a476aad534
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0007d5258827c7d5eccb0b1e71c29b8bf6335cf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0007d5258827c7d5eccb0b1e71c29b8bf6335cf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9cd5eea74eaf02ce106a7fff3098534f64d9e681
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9cd5eea74eaf02ce106a7fff3098534f64d9e681
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f38c5f768ffaab47633e978994e61e36d3fcb4ac
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f38c5f768ffaab47633e978994e61e36d3fcb4ac
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0573deeea77e7c4259d2f2089de97582c54895b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0573deeea77e7c4259d2f2089de97582c54895b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe9a967ef6749c576d1d52c77043780d547ff574
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe9a967ef6749c576d1d52c77043780d547ff574
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88473bb831cd6f4569155df11efc8789bf619b39
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88473bb831cd6f4569155df11efc8789bf619b39
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0daf4b116746ffe9ee0cc33ded3199cb7fa533bf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0daf4b116746ffe9ee0cc33ded3199cb7fa533bf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac3aaa7f4e1b7f666ff5af498cb090409a3cd3b5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac3aaa7f4e1b7f666ff5af498cb090409a3cd3b5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99a9961b4eab4f85dbb642bff7522a6d32e25ee9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99a9961b4eab4f85dbb642bff7522a6d32e25ee9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88c1ea57bf79ece46c833a771afb90047cacf53
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88c1ea57bf79ece46c833a771afb90047cacf53
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e0c1e7260958bb37345fe38e54fc7c9d49b69bc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e0c1e7260958bb37345fe38e54fc7c9d49b69bc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a58a840eb58d1f7cda767a6147922e6c52c38ecc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a58a840eb58d1f7cda767a6147922e6c52c38ecc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebd365e2b298274b2284834bc6b2179bc67fe247
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebd365e2b298274b2284834bc6b2179bc67fe247
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c021f05574670a7a266e5d2d78a05c9057bbcdf0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c021f05574670a7a266e5d2d78a05c9057bbcdf0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84f106cb4b3505057e314ead3d398ce797f6aa24
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84f106cb4b3505057e314ead3d398ce797f6aa24
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9faa143e83514defe13e1b0280b6c504be9e214c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9faa143e83514defe13e1b0280b6c504be9e214c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a779aa8c334cc5d5624bad7037f9f247f23fcf6e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a779aa8c334cc5d5624bad7037f9f247f23fcf6e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04afdc895bedab2bd5f303ccb1b13d365968d265
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04afdc895bedab2bd5f303ccb1b13d365968d265
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f289bd8e744cb9b88c8f3c8b9216ae60403fb01
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f289bd8e744cb9b88c8f3c8b9216ae60403fb01
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57dbf9b87486ea416637c3a0bf36733ef26066d1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57dbf9b87486ea416637c3a0bf36733ef26066d1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e8f61f1c89fc0a03883258136efe23c7952932a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e8f61f1c89fc0a03883258136efe23c7952932a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fda3d9b52997cae2e04211a06f7e869631a09bd4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fda3d9b52997cae2e04211a06f7e869631a09bd4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b242d8f484b2ef600d6e6e7300f37c9f24383a79
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b242d8f484b2ef600d6e6e7300f37c9f24383a79
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca21c95d97733a61795db55b0879304985d7ad4e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca21c95d97733a61795db55b0879304985d7ad4e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3122a8cf090ef9266708d5484d888bfd117ad3da
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3122a8cf090ef9266708d5484d888bfd117ad3da
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60dbdebebb5fa8b990b38dafe75e5ba3987b87e3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60dbdebebb5fa8b990b38dafe75e5ba3987b87e3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52173993b77d69b84592caf1441e1d01e8232c33
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52173993b77d69b84592caf1441e1d01e8232c33
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58ab27ed262159fec22947ef30966d5463364634
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58ab27ed262159fec22947ef30966d5463364634
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fbb18a5146a134e7a919e294ef78f03be395483
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fbb18a5146a134e7a919e294ef78f03be395483
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5a99893c6c5b20ae09b54dbcbce7a6f5902234f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5a99893c6c5b20ae09b54dbcbce7a6f5902234f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd3be8cc4c4d1f9a77dbd991848d9cb52d2ac9d6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd3be8cc4c4d1f9a77dbd991848d9cb52d2ac9d6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82bf46eba8152442504057550f710c4cc6223545
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82bf46eba8152442504057550f710c4cc6223545
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:801c5fb168f6b3fe7597190b21d508aad34814b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:801c5fb168f6b3fe7597190b21d508aad34814b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:112b171160760c074b5028c683aa8baddd2df9ac
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:112b171160760c074b5028c683aa8baddd2df9ac
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb5a0ad217d5d21519e766f89e14b0daec1052a0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb5a0ad217d5d21519e766f89e14b0daec1052a0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:897a498f630693ba5a52cd7136fb0f786591eded
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:897a498f630693ba5a52cd7136fb0f786591eded
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40e0c343ba6aaca62f395798181909b395c9315a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40e0c343ba6aaca62f395798181909b395c9315a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5aa800fe1a5720afa900e4894f8ac32e15b2c5d7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5aa800fe1a5720afa900e4894f8ac32e15b2c5d7
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbed1bc4864d3cf9ad1b0b166b0d774bb90c0869
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbed1bc4864d3cf9ad1b0b166b0d774bb90c0869
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:674609445ef8c700a2a7b844321184f0b86e6106
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:674609445ef8c700a2a7b844321184f0b86e6106
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5b6a5bb42946ccfa2f627079651e96fd00d1a24
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5b6a5bb42946ccfa2f627079651e96fd00d1a24
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a47f70c22a0917162a6c138797cea71b2230d64
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a47f70c22a0917162a6c138797cea71b2230d64
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5eabfa9943028d2ce6134f1ebecfeda1e4d04ad8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5eabfa9943028d2ce6134f1ebecfeda1e4d04ad8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:74651cbc952ce73af8e3a4bdf393a6f8db66a0bd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:74651cbc952ce73af8e3a4bdf393a6f8db66a0bd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85f3a0e0ec8f6f6dc62d777f00067c57ea49c2e9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85f3a0e0ec8f6f6dc62d777f00067c57ea49c2e9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47e83d37ca0e0f9367379a1abd909344a446ad9d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47e83d37ca0e0f9367379a1abd909344a446ad9d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:460496d383485d00111173d821b337e36587349f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:460496d383485d00111173d821b337e36587349f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:144d18b59ba4d8f702354498648ca86de89befa0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:144d18b59ba4d8f702354498648ca86de89befa0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:358ea6339082db65ce8c01d2bb0dd9fdf072426f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:358ea6339082db65ce8c01d2bb0dd9fdf072426f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c15a39bccd18c4aa1240e38e2fd8cda0faad8f40
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c15a39bccd18c4aa1240e38e2fd8cda0faad8f40
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1b7b2d9044f70d761daf8276acee7b6d18d9c9d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1b7b2d9044f70d761daf8276acee7b6d18d9c9d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df10346e4b4dad86a2b808c9764160f07a41e71d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df10346e4b4dad86a2b808c9764160f07a41e71d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d651593cc660b96cbc96c835c3aa24cf64b94ea3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d651593cc660b96cbc96c835c3aa24cf64b94ea3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f64aeac5413e7fd87ef791059af6519c834a4f86
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f64aeac5413e7fd87ef791059af6519c834a4f86
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:61a2da6b555893b162947e8de40ce37dc5a58e14
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:61a2da6b555893b162947e8de40ce37dc5a58e14
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac319660f81e5177cfbe614de38a8dc4ad78ba07
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac319660f81e5177cfbe614de38a8dc4ad78ba07
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:269092b0c9d4054335a3298c694455e6bdcb873e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:269092b0c9d4054335a3298c694455e6bdcb873e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b987c966576d82cd74fecdfe609911a4c6b5dea
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b987c966576d82cd74fecdfe609911a4c6b5dea
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a67d83e13bd6a83706909b8560df91bbbafe47c2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a67d83e13bd6a83706909b8560df91bbbafe47c2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d37a7ecb1c4b568bd84767dce65f6ae30fcf7cfa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d37a7ecb1c4b568bd84767dce65f6ae30fcf7cfa
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfa96bdc7d1c37cba266107122edb6b980e2c3f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfa96bdc7d1c37cba266107122edb6b980e2c3f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d005777194eaa4777a64ec7f4c69e68b2c8fe6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d005777194eaa4777a64ec7f4c69e68b2c8fe6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca5d43b192e93375450af2e18b3eb4a1527bf6ae
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca5d43b192e93375450af2e18b3eb4a1527bf6ae
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88422a19d36528e9e9569a9fbbc2000077426a0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88422a19d36528e9e9569a9fbbc2000077426a0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82eb09a463b138daac463604b9c69bceb491d1d3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82eb09a463b138daac463604b9c69bceb491d1d3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1936f774cdc3981a2924be88d09e37b7afe3ce1f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1936f774cdc3981a2924be88d09e37b7afe3ce1f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69780bd8eea9a3ddea6415dfc1408e512adfcacb
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69780bd8eea9a3ddea6415dfc1408e512adfcacb
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48b8bdbd5e307a3d7aa3b6bb5ffc710a7ff8bb10
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48b8bdbd5e307a3d7aa3b6bb5ffc710a7ff8bb10
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d2dceed22cb597ba72fa2098585912b1bad61af
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d2dceed22cb597ba72fa2098585912b1bad61af
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f54c2456d8551e2ee62c7e0d3ca1c69c148b8055
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f54c2456d8551e2ee62c7e0d3ca1c69c148b8055
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66526d18ffb34479988aba54dbb39172e378fec2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66526d18ffb34479988aba54dbb39172e378fec2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ebb9eec4ed2c13ac6f43f59ba1a16558fac7059
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ebb9eec4ed2c13ac6f43f59ba1a16558fac7059
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57ccb785424e3e57c929fd6d9fbc7863c0dde688
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57ccb785424e3e57c929fd6d9fbc7863c0dde688
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3f7d0967febbaad65235c0290d9ff05623930b8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3f7d0967febbaad65235c0290d9ff05623930b8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16b0fc842f33953c18a5885bbc956cc438c12ede
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16b0fc842f33953c18a5885bbc956cc438c12ede
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:147e02153bcd5b87a1df235245de242f647a23f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:147e02153bcd5b87a1df235245de242f647a23f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:147ab58444a288c30ea58c2fc4a30021ad766e7d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:147ab58444a288c30ea58c2fc4a30021ad766e7d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c33a7a0b362a5252019240f432934ebba60f64f4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c33a7a0b362a5252019240f432934ebba60f64f4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:840de7ca6fe2bc9661be28dc318128a19b730351
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:840de7ca6fe2bc9661be28dc318128a19b730351
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:14753a5195c270b99138a251009c4c97d7551747
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:14753a5195c270b99138a251009c4c97d7551747
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8290517122f13981bd39126a7e17a1b0b890c1b8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8290517122f13981bd39126a7e17a1b0b890c1b8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8232006400ad7afeac3f99d5fedbcf279737f57d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8232006400ad7afeac3f99d5fedbcf279737f57d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e579b4796db5b3f699487f9a3f13e31003ee028
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e579b4796db5b3f699487f9a3f13e31003ee028
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:639bfe418326fb59d714bccee6ec705c7a86fa6b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:639bfe418326fb59d714bccee6ec705c7a86fa6b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78cd3b238d446f0e74d44e3632ae34f82949dbf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78cd3b238d446f0e74d44e3632ae34f82949dbf6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f0871475ca9340d7c90d7cd7ab17a6391794eed
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f0871475ca9340d7c90d7cd7ab17a6391794eed
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d22c1e0a6ff45a92419e61d0f306ab872c7d85c0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d22c1e0a6ff45a92419e61d0f306ab872c7d85c0
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dec95c83f6eec5afba005117f8f46b2adcb3215c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dec95c83f6eec5afba005117f8f46b2adcb3215c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18065e2712d8bbafe92ac479e0aba6b0fdf2aa3c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18065e2712d8bbafe92ac479e0aba6b0fdf2aa3c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4b199855b661ed046dd5dc77d381df8f5390235
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4b199855b661ed046dd5dc77d381df8f5390235
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d5a5fe20d5b8556df4bf40f56293878173579d96
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d5a5fe20d5b8556df4bf40f56293878173579d96
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b161daca219e2070157a1bc010bb166b2d6728d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b161daca219e2070157a1bc010bb166b2d6728d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c16879829c5de5c78ab26e844ac9103838b4eb1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c16879829c5de5c78ab26e844ac9103838b4eb1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54ccd95125e0d985c28c3547705dbf1e1d37f53e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54ccd95125e0d985c28c3547705dbf1e1d37f53e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fb9f96e295cd1ea2d14c19e1bb9429daf712063
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fb9f96e295cd1ea2d14c19e1bb9429daf712063
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df0aac51625f9def1e8ab9f14e7c2d69693f3079
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df0aac51625f9def1e8ab9f14e7c2d69693f3079
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efe93442eb5ac748361c3a45b5c4a0955e4c21e5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efe93442eb5ac748361c3a45b5c4a0955e4c21e5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b03bac39c84e3c8c3c7ea71ec4ee7eae2f8f9dc8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b03bac39c84e3c8c3c7ea71ec4ee7eae2f8f9dc8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b85c17c58d0e0c9dfb81cec58956baf2dee17ea2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b85c17c58d0e0c9dfb81cec58956baf2dee17ea2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:743acc7638abfed631117a6101364e1b4f9cfff8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:743acc7638abfed631117a6101364e1b4f9cfff8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3e3fcb076ce7b100a8f407c3d7c74079069a2f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3e3fcb076ce7b100a8f407c3d7c74079069a2f9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c2f121a36baa32c285a5896628b9c62501cb338
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c2f121a36baa32c285a5896628b9c62501cb338
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21926c26a7aa9e95abd908c064acc9f916187a3f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21926c26a7aa9e95abd908c064acc9f916187a3f
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8069f93b84e0d45176084ebed3bb0a080bb4b38c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8069f93b84e0d45176084ebed3bb0a080bb4b38c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eec060d78861f7eeef79060c00ef791725678bcf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eec060d78861f7eeef79060c00ef791725678bcf
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f6272ac0bafae22e60979e5aec353eac4b07196
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f6272ac0bafae22e60979e5aec353eac4b07196
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67242d5fe37fb1ad53770fe2d9fb31f1aad05c80
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67242d5fe37fb1ad53770fe2d9fb31f1aad05c80
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc2a0891600c928ef14d0e21da720df86e599162
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc2a0891600c928ef14d0e21da720df86e599162
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1e57745fa14639f8202ce8ba98d7b4c7fb0d77d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1e57745fa14639f8202ce8ba98d7b4c7fb0d77d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7439d966185ce87bd20d984d2c1f5a070463c30
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7439d966185ce87bd20d984d2c1f5a070463c30
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:165e63165667c1c0470df4cf6f948e31dfec4dc9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:165e63165667c1c0470df4cf6f948e31dfec4dc9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c981911b4b0254afe0e36d6bd21077bbe14e57d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c981911b4b0254afe0e36d6bd21077bbe14e57d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22fa97810d2f22a9034262c883d25746334bef43
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22fa97810d2f22a9034262c883d25746334bef43
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c96d972916f9615b2a4fa67ce9638d8e14ffac4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c96d972916f9615b2a4fa67ce9638d8e14ffac4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:634f259df74fa60f783d05f789da933c33ea966b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:634f259df74fa60f783d05f789da933c33ea966b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bac73abaa0fedfb2b80a7ec7e905e893f519586
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bac73abaa0fedfb2b80a7ec7e905e893f519586
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b0da445cef616842b477b03e0648d043d790a82
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b0da445cef616842b477b03e0648d043d790a82
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59fa24e62a3fab8caba66d592bfb18e3afefb323
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59fa24e62a3fab8caba66d592bfb18e3afefb323
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f44d642ea616428c6e2ecdfd725838063fab9257
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f44d642ea616428c6e2ecdfd725838063fab9257
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8da354dfbaf5a4de4e79e8df2f0384730f4c8f3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8da354dfbaf5a4de4e79e8df2f0384730f4c8f3
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a46c4e2bb404447d3b3e98c3327d37d05a55895
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a46c4e2bb404447d3b3e98c3327d37d05a55895
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6467b7bc5e706331a5ca7bebf6f01cf43be63104
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6467b7bc5e706331a5ca7bebf6f01cf43be63104
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b15f6bf37ddcc403b0263eab3dd9cd0424a5efad
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b15f6bf37ddcc403b0263eab3dd9cd0424a5efad
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e7937bdeee218cfa2469ebf1697e51a1bf2b180
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e7937bdeee218cfa2469ebf1697e51a1bf2b180
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2be7fff6991b4ad06696b58ccdcf0eae9085a53
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2be7fff6991b4ad06696b58ccdcf0eae9085a53
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93c65f792072396ba81adbb866ac3bbb8ce3adb6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93c65f792072396ba81adbb866ac3bbb8ce3adb6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72d5535229c842f51d64c4b1440a07323d7b9ef8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72d5535229c842f51d64c4b1440a07323d7b9ef8
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfb147574cd1fe654733cc12c7d122058572e7e5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfb147574cd1fe654733cc12c7d122058572e7e5
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5e13c55ce21ec68b4e58459907cc9c6f3b8a0b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5e13c55ce21ec68b4e58459907cc9c6f3b8a0b2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8ce63583d582365d0e47a1c202bfbeb440a32e6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8ce63583d582365d0e47a1c202bfbeb440a32e6
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4670748cf1fd90c5c2db335a421439b86df9ea91
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4670748cf1fd90c5c2db335a421439b86df9ea91
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9918ea5851a45c7cd6e4ed6f0f50de5c5266b0d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9918ea5851a45c7cd6e4ed6f0f50de5c5266b0d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98eb55fa4bf42e951da4bb8d6e7adfb240be8537
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98eb55fa4bf42e951da4bb8d6e7adfb240be8537
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:219c3e9a91ca6736d870c63e62652c5e4fa795cc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:219c3e9a91ca6736d870c63e62652c5e4fa795cc
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:757650f20f601a8ba81a3bac84dc33742576fc92
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:757650f20f601a8ba81a3bac84dc33742576fc92
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:522e0a6fbff6f3e4e432d45c59c5bf42afe7cd0e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:522e0a6fbff6f3e4e432d45c59c5bf42afe7cd0e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3b269910984814d0b960d824eb4a7412dff854c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3b269910984814d0b960d824eb4a7412dff854c
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d5ae9cc72441eeafe39a8c6583be112eef2373e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d5ae9cc72441eeafe39a8c6583be112eef2373e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8783271998349602232049e42276d455685fdbd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8783271998349602232049e42276d455685fdbd
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a283201f374b6602c8cbcfcc8972bdae80cf0a66
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a283201f374b6602c8cbcfcc8972bdae80cf0a66
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11b97730143fb47a7b1b4cbd179594664e19c726
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11b97730143fb47a7b1b4cbd179594664e19c726
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46cc434c6144593864ee53f51a795e8beb3272b1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46cc434c6144593864ee53f51a795e8beb3272b1
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:79d7b2f3e597ed546673ddac4a415f36b0562d0a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:79d7b2f3e597ed546673ddac4a415f36b0562d0a
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4862eca693a28dc4c401962ef4711d22b9516ba2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4862eca693a28dc4c401962ef4711d22b9516ba2
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4533de3a7b2f7ca04d79df0f01f9e0a23efa3944
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4533de3a7b2f7ca04d79df0f01f9e0a23efa3944
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f84c4e62d1a49485bba9288605641a45631c816
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f84c4e62d1a49485bba9288605641a45631c816
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:463545ff5b35ee854242c0d3cd6cf928e6073992
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:463545ff5b35ee854242c0d3cd6cf928e6073992
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8024f419db8e9592aa072c5e5c75a5f5cab4a30d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8024f419db8e9592aa072c5e5c75a5f5cab4a30d
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0e08035d61343a83a0d26b9707d1c481228c718
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0e08035d61343a83a0d26b9707d1c481228c718
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55590fdd193d846d138a4902dbd2748b1e479b86
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55590fdd193d846d138a4902dbd2748b1e479b86
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a7d4ca6759dc2437b9bf2bbdcb004845c8d0ff9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a7d4ca6759dc2437b9bf2bbdcb004845c8d0ff9
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9cdce57a4e0ffd57c777b5e400e072d3ec5ef5b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9cdce57a4e0ffd57c777b5e400e072d3ec5ef5b
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df6455eb53f00f6fc854034ec5eca1bbe1fd90f4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df6455eb53f00f6fc854034ec5eca1bbe1fd90f4
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e440c2ba17e8673972891a14a662eb039457a2e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e440c2ba17e8673972891a14a662eb039457a2e
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34c9c44261262e14a22e7e25ab4fee8cfd01f872
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34c9c44261262e14a22e7e25ab4fee8cfd01f872
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85c134fcbfed470e5001855bb64c20d9d0de7667
11/22/2024 12:13:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85c134fcbfed470e5001855bb64c20d9d0de7667
11/22/2024 12:14:00 PM UTC [INFO] Received an event for node: 674068f011fb139cb87df6af
11/22/2024 12:14:00 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068f011fb139cb87df6af
11/22/2024 12:14:00 PM UTC [INFO] Received an event for node: 67406d0911fb139cb87dfa79
11/22/2024 12:15:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0911fb139cb87dfa79
11/22/2024 12:15:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad2
11/22/2024 12:15:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad3
11/22/2024 12:15:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad4
11/22/2024 12:16:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad5
11/22/2024 12:16:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad6
11/22/2024 12:16:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad7
11/22/2024 12:16:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad8
11/22/2024 12:16:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ad9
11/22/2024 12:16:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ada
11/22/2024 12:16:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0adb
11/22/2024 12:16:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0adc
11/22/2024 12:16:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0add
11/22/2024 12:16:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ade
11/22/2024 12:16:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0adf
11/22/2024 12:16:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae0
11/22/2024 12:16:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae1
11/22/2024 12:16:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae2
11/22/2024 12:16:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae3
11/22/2024 12:16:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae4
11/22/2024 12:16:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae5
11/22/2024 12:16:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae6
11/22/2024 12:16:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae7
11/22/2024 12:16:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae9
11/22/2024 12:16:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aeb
11/22/2024 12:16:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aec
11/22/2024 12:16:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aed
11/22/2024 12:16:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aee
11/22/2024 12:16:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aef
11/22/2024 12:16:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af0
11/22/2024 12:16:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af1
11/22/2024 12:16:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af2
11/22/2024 12:16:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af3
11/22/2024 12:16:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af4
11/22/2024 12:16:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af5
11/22/2024 12:16:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af6
11/22/2024 12:16:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af7
11/22/2024 12:16:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af8
11/22/2024 12:16:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0af9
11/22/2024 12:16:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0afa
11/22/2024 12:16:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0afb
11/22/2024 12:16:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0afc
11/22/2024 12:16:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0afd
11/22/2024 12:16:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0afe
11/22/2024 12:16:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0aff
11/22/2024 12:16:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b00
11/22/2024 12:16:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b01
11/22/2024 12:16:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b02
11/22/2024 12:16:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b03
11/22/2024 12:16:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b04
11/22/2024 12:16:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b05
11/22/2024 12:16:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b06
11/22/2024 12:16:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b07
11/22/2024 12:16:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b08
11/22/2024 12:16:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b09
11/22/2024 12:16:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0a
11/22/2024 12:16:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0b
11/22/2024 12:16:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0c
11/22/2024 12:16:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0d
11/22/2024 12:16:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0e
11/22/2024 12:16:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b0f
11/22/2024 12:16:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b10
11/22/2024 12:16:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b11
11/22/2024 12:16:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b12
11/22/2024 12:16:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b13
11/22/2024 12:16:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b14
11/22/2024 12:16:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b15
11/22/2024 12:16:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b16
11/22/2024 12:16:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b17
11/22/2024 12:16:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b18
11/22/2024 12:16:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b19
11/22/2024 12:16:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1a
11/22/2024 12:16:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1b
11/22/2024 12:16:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1c
11/22/2024 12:16:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1d
11/22/2024 12:16:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1e
11/22/2024 12:16:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b1f
11/22/2024 12:16:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b20
11/22/2024 12:16:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b21
11/22/2024 12:16:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b22
11/22/2024 12:16:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b23
11/22/2024 12:16:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b24
11/22/2024 12:16:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b25
11/22/2024 12:16:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b26
11/22/2024 12:16:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b27
11/22/2024 12:16:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b28
11/22/2024 12:16:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b29
11/22/2024 12:16:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2a
11/22/2024 12:16:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2b
11/22/2024 12:16:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2c
11/22/2024 12:16:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2d
11/22/2024 12:16:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2e
11/22/2024 12:16:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b2f
11/22/2024 12:16:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b30
11/22/2024 12:16:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b31
11/22/2024 12:16:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b32
11/22/2024 12:16:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b33
11/22/2024 12:16:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b34
11/22/2024 12:16:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b35
11/22/2024 12:16:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b36
11/22/2024 12:16:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b37
11/22/2024 12:16:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b38
11/22/2024 12:16:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b39
11/22/2024 12:16:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3a
11/22/2024 12:16:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3b
11/22/2024 12:16:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3c
11/22/2024 12:16:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3d
11/22/2024 12:16:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3e
11/22/2024 12:16:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b3f
11/22/2024 12:16:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b40
11/22/2024 12:16:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b41
11/22/2024 12:16:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b42
11/22/2024 12:16:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b43
11/22/2024 12:16:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b44
11/22/2024 12:16:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b45
11/22/2024 12:16:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b46
11/22/2024 12:16:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b47
11/22/2024 12:16:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b48
11/22/2024 12:16:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b49
11/22/2024 12:16:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4a
11/22/2024 12:16:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4b
11/22/2024 12:16:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4c
11/22/2024 12:16:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4d
11/22/2024 12:16:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4e
11/22/2024 12:16:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b4f
11/22/2024 12:16:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b50
11/22/2024 12:16:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b51
11/22/2024 12:16:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b52
11/22/2024 12:16:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b53
11/22/2024 12:16:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b54
11/22/2024 12:16:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b55
11/22/2024 12:16:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b56
11/22/2024 12:16:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b57
11/22/2024 12:16:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b58
11/22/2024 12:16:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b59
11/22/2024 12:16:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5a
11/22/2024 12:16:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5b
11/22/2024 12:16:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5c
11/22/2024 12:16:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5d
11/22/2024 12:16:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5e
11/22/2024 12:16:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b5f
11/22/2024 12:16:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b60
11/22/2024 12:16:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b61
11/22/2024 12:16:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b62
11/22/2024 12:16:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b63
11/22/2024 12:16:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b64
11/22/2024 12:16:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b65
11/22/2024 12:16:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b66
11/22/2024 12:16:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b67
11/22/2024 12:16:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b68
11/22/2024 12:16:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b69
11/22/2024 12:16:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6a
11/22/2024 12:16:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6b
11/22/2024 12:16:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6c
11/22/2024 12:16:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6d
11/22/2024 12:16:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6e
11/22/2024 12:16:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b6f
11/22/2024 12:16:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b70
11/22/2024 12:16:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b71
11/22/2024 12:16:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b72
11/22/2024 12:16:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b73
11/22/2024 12:16:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b74
11/22/2024 12:16:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b75
11/22/2024 12:16:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b76
11/22/2024 12:16:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b77
11/22/2024 12:16:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b78
11/22/2024 12:16:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b79
11/22/2024 12:16:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7a
11/22/2024 12:16:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7b
11/22/2024 12:16:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7c
11/22/2024 12:16:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7d
11/22/2024 12:16:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7e
11/22/2024 12:16:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b7f
11/22/2024 12:16:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b80
11/22/2024 12:16:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b81
11/22/2024 12:16:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b82
11/22/2024 12:16:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b83
11/22/2024 12:16:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b84
11/22/2024 12:16:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b85
11/22/2024 12:16:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b86
11/22/2024 12:16:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b87
11/22/2024 12:16:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b88
11/22/2024 12:16:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b89
11/22/2024 12:16:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8a
11/22/2024 12:16:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8b
11/22/2024 12:16:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8c
11/22/2024 12:16:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8d
11/22/2024 12:16:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8e
11/22/2024 12:16:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b8f
11/22/2024 12:16:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b90
11/22/2024 12:16:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b91
11/22/2024 12:16:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b92
11/22/2024 12:17:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b93
11/22/2024 12:17:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b94
11/22/2024 12:17:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b95
11/22/2024 12:17:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b96
11/22/2024 12:17:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b97
11/22/2024 12:17:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b98
11/22/2024 12:17:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b99
11/22/2024 12:17:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9a
11/22/2024 12:17:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9b
11/22/2024 12:17:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9c
11/22/2024 12:17:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9d
11/22/2024 12:17:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9e
11/22/2024 12:17:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0b9f
11/22/2024 12:17:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba0
11/22/2024 12:17:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba2
11/22/2024 12:17:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba3
11/22/2024 12:17:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba4
11/22/2024 12:17:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba5
11/22/2024 12:17:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba6
11/22/2024 12:17:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba7
11/22/2024 12:17:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba8
11/22/2024 12:17:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ba9
11/22/2024 12:17:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0baa
11/22/2024 12:17:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0bab
11/22/2024 12:17:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0bac
11/22/2024 12:17:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0bad
11/22/2024 12:17:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0bb0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0911fb139cb87dfa79
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ac7
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ac8
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ac9
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aca
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0acb
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0acc
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0acd
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ace
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad2
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad3
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad4
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad5
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad6
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad7
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad8
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ad9
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ada
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0adb
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0adc
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0add
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ade
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0adf
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae1
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae2
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae3
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae4
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae5
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae6
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae7
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae9
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aeb
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aec
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aed
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aee
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aef
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af1
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af2
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af3
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af4
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af5
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af6
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af7
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af8
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0af9
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0afa
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0afb
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0afc
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0afd
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0afe
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0aff
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b00
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b01
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b02
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b03
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b04
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b05
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b06
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b07
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b08
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b09
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b0f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b10
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b11
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b12
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b13
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b14
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b15
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b16
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b17
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b18
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b19
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b1f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b20
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b21
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b22
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b23
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b24
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b25
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b26
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b27
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b28
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b29
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b2f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b30
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b31
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b32
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b33
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b34
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b35
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b36
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b37
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b38
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b39
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b3f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b40
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b41
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b42
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b43
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b44
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b45
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b46
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b47
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b48
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b49
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b4f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b50
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b51
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b52
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b53
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b54
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b55
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b56
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b57
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b58
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b59
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b5f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b60
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b61
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b62
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b63
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b64
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b65
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b66
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b67
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b68
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b69
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b6f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b70
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b71
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b72
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b73
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b74
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b75
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b76
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b77
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b78
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b79
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b7f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b80
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b81
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b82
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b83
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b84
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b85
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b86
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b87
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b88
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b89
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b8f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b90
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b91
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b92
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b93
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b94
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b95
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b96
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b97
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b98
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b99
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9a
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9b
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9c
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9d
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9e
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0b9f
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba2
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba3
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba4
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba5
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba6
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba7
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba8
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ba9
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0baa
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bab
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bac
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bad
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bb0
11/22/2024 12:17:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bb1
11/22/2024 12:17:09 PM UTC [INFO] Received an event for node: 67406d1111fb139cb87dfaba
11/22/2024 12:19:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:267de0b96923394b6e74f389350a78cfd9ac3f30', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1111fb139cb87dfaba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:267de0b96923394b6e74f389350a78cfd9ac3f30', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1111fb139cb87dfaba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:48dac77097292ffc7f40dd1b907dabb58d9ec749', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:48dac77097292ffc7f40dd1b907dabb58d9ec749', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1ded3b93e8a17ae6c8847d19db47f13fea2796d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1ded3b93e8a17ae6c8847d19db47f13fea2796d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ac161ae03e51608fd1150190f211621441773c85', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac161ae03e51608fd1150190f211621441773c85', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4ad45bb07e0c330d032d3344651e4d6420c66054', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4ad45bb07e0c330d032d3344651e4d6420c66054', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bc9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e1108332eb6d2dbf895e24b6ddd151611f80b993', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1108332eb6d2dbf895e24b6ddd151611f80b993', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9b67c868f4c334f020ae5508aed7d422540f95b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b67c868f4c334f020ae5508aed7d422540f95b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a8c3b6068e1016bd115fd1170d610949cdfaf158', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a8c3b6068e1016bd115fd1170d610949cdfaf158', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9be079efbb1b0757f282e9dd44512fc11c0804dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9be079efbb1b0757f282e9dd44512fc11c0804dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5aca677a130cba71cb8865a625ebe5326715dca9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5aca677a130cba71cb8865a625ebe5326715dca9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bcf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f10d732587d8ec08d8f392006c76b37fd5373734', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f10d732587d8ec08d8f392006c76b37fd5373734', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0d3028c458033fe368e21783348f4c804f07b799', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0d3028c458033fe368e21783348f4c804f07b799', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:954602c6f6c423b9ec98548afabc2937d592d8c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:954602c6f6c423b9ec98548afabc2937d592d8c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e5ca8b6f23c1067b9f9ea605e6d1388366a1c00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e5ca8b6f23c1067b9f9ea605e6d1388366a1c00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e876baa5abb21bdaa7de077e0da3fe7b19a930a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e876baa5abb21bdaa7de077e0da3fe7b19a930a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4891ff7e1fa9936b404f70e68f5ed998aaf9f9f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bdb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4891ff7e1fa9936b404f70e68f5ed998aaf9f9f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bdb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cfc8f404e30fdf9a3175dc25d6e2df53b9c9ccc3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bdf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cfc8f404e30fdf9a3175dc25d6e2df53b9c9ccc3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bdf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:449956f071324efcdf11fc6a90cbb1f042586bb3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:449956f071324efcdf11fc6a90cbb1f042586bb3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc1e77d5a810692723066ec1e1360db7cf6fee5f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc1e77d5a810692723066ec1e1360db7cf6fee5f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8531a8d650a3ecb327c121cbec11624c2762a612', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8531a8d650a3ecb327c121cbec11624c2762a612', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:845a3e06dbd781df43e818ad54179928aba94041', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:845a3e06dbd781df43e818ad54179928aba94041', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0be8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95c4796229ba30736bee122cf6b305b46fd57a06', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95c4796229ba30736bee122cf6b305b46fd57a06', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8388e0aaadd9147ff22d47ec7413cc4ff113cac3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8388e0aaadd9147ff22d47ec7413cc4ff113cac3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d72b0b9df4130402627a1fba03ccdd663d7ed4b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d72b0b9df4130402627a1fba03ccdd663d7ed4b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:65c214624686c4737b4f3b81f2700a188a4124b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:65c214624686c4737b4f3b81f2700a188a4124b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3de04a8a5b62250fd10a9189bd0a8bbe2a3ae1e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3de04a8a5b62250fd10a9189bd0a8bbe2a3ae1e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ef10c83ee989925562e0dd7529ac64da440f100', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ef10c83ee989925562e0dd7529ac64da440f100', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:99770da0ef68f668fb37cac0282d2e27a88fac0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:99770da0ef68f668fb37cac0282d2e27a88fac0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ece6da4429223131b625c246900a9ff06af3465', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ece6da4429223131b625c246900a9ff06af3465', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bf9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:03d47df06604fc04aac22949a913228dd9ef0a38', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bfa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:03d47df06604fc04aac22949a913228dd9ef0a38', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bfa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3fa3b376538a2dfe9431c581e3382e4dfc8dcea5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3fa3b376538a2dfe9431c581e3382e4dfc8dcea5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:21f833b55e95a58fac47d9fa9344dfa99cd7abf3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:21f833b55e95a58fac47d9fa9344dfa99cd7abf3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0bff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:30617516508834549f13b9ce3bde495f40371325', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30617516508834549f13b9ce3bde495f40371325', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0a3e8ebbb6c96a0df8814ebd27cd52059aa48cf4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0a3e8ebbb6c96a0df8814ebd27cd52059aa48cf4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7f2bc978af39672dc77cd778ae1ccfb35f228c67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7f2bc978af39672dc77cd778ae1ccfb35f228c67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9beff2714ff60b749d490d87f956535d18a54cee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9beff2714ff60b749d490d87f956535d18a54cee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e902c14514e2f030e2c490aabef32d970ede4d7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e902c14514e2f030e2c490aabef32d970ede4d7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a486f28643f7f15a41c20f394eedc6de9ff541d9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a486f28643f7f15a41c20f394eedc6de9ff541d9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:12c865d02fa5102cd2b0cf8c7ce8096c6e6b4160', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:12c865d02fa5102cd2b0cf8c7ce8096c6e6b4160', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:273242853756a672042e4d89f5ae28736e0079c1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:273242853756a672042e4d89f5ae28736e0079c1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b9a0562c089e73ea9c8625b3625e164671d547be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b9a0562c089e73ea9c8625b3625e164671d547be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:be3469c0a598fc9fcdecabc32909991fe5a2795e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be3469c0a598fc9fcdecabc32909991fe5a2795e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:63a3a122c355e5276135c8cc194676ee244cecfd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63a3a122c355e5276135c8cc194676ee244cecfd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a4a1b3c20bd82133f6a60563755c404073de2a50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4a1b3c20bd82133f6a60563755c404073de2a50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:675667115fcd6923fdce4708478c7b53522cfb35', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:675667115fcd6923fdce4708478c7b53522cfb35', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2771a3c1e5488a78a4369ee4b08bd5c234615c6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2771a3c1e5488a78a4369ee4b08bd5c234615c6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b23250a9a4518a66aff63ff0b5996af8f961e091', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b23250a9a4518a66aff63ff0b5996af8f961e091', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aa48af53658bfa5b946f5a880e9619f334f168cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aa48af53658bfa5b946f5a880e9619f334f168cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f8c501f777b423a20905b8374b38ab41ff6cb0cb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8c501f777b423a20905b8374b38ab41ff6cb0cb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b21c2e4465127427ae2551a0a8c060c2b5047421', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b21c2e4465127427ae2551a0a8c060c2b5047421', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ee1ba10e23b159c99f60859a0bfe96f842971bfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee1ba10e23b159c99f60859a0bfe96f842971bfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d67378e8ef7fff47a3fcefe92e34e998e9d9fc5a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d67378e8ef7fff47a3fcefe92e34e998e9d9fc5a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:062bc71b4687418ad03939a35249f22d0d7ff7e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:062bc71b4687418ad03939a35249f22d0d7ff7e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:423d348f5be4f8a1c2e6e3368f203147751bcfc7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:423d348f5be4f8a1c2e6e3368f203147751bcfc7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:574467e8e4e716be120b7d0b53a02edb1484d528', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:574467e8e4e716be120b7d0b53a02edb1484d528', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c134ce6767506352407b502df651dd8053c0f047', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c134ce6767506352407b502df651dd8053c0f047', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e515666c526a958ea14316d0f355990bdf82b7f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e515666c526a958ea14316d0f355990bdf82b7f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3f4b722dc722d49ccc9f33285fd4b8df71257680', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f4b722dc722d49ccc9f33285fd4b8df71257680', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5c2ae828f7e9ddc525c5f002270c9dc2a59ec253', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5c2ae828f7e9ddc525c5f002270c9dc2a59ec253', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:875df217dbc12c4d9e26cb90903bbc667cea111c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:875df217dbc12c4d9e26cb90903bbc667cea111c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0e98f4f34635cd2f5cc78b20845a1366932f869d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0e98f4f34635cd2f5cc78b20845a1366932f869d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:09ba0cc5ec423a3fe2eba0b413785450e2d9089b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:09ba0cc5ec423a3fe2eba0b413785450e2d9089b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5712007dc85d3adad9cab917a16fc2cbd7ba71ab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5712007dc85d3adad9cab917a16fc2cbd7ba71ab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a5de74096d4f78ca71f3d47b00f9dc1c11b40fe2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5de74096d4f78ca71f3d47b00f9dc1c11b40fe2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:46a612f8606169c106a21712e841cf1e6acb32b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:46a612f8606169c106a21712e841cf1e6acb32b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0cccd14f2773653c4118c242f508d07e8a01a8f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0cccd14f2773653c4118c242f508d07e8a01a8f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d826e12216a8dc93540cfa494165cbbcbd1d0d74', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d826e12216a8dc93540cfa494165cbbcbd1d0d74', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e32a3ca2501c3ef1801ede133c74ab7e787472ee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e32a3ca2501c3ef1801ede133c74ab7e787472ee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:71fef95dd76d27fd1671022059383b9afb3a9a8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:71fef95dd76d27fd1671022059383b9afb3a9a8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7c11fb139cb87e0c4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:897f3e9d59a96706558eff67d1c2776ba40e7a1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:897f3e9d59a96706558eff67d1c2776ba40e7a1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3fbcf305f8ad2df3a18900e33bff38216abdccbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3fbcf305f8ad2df3a18900e33bff38216abdccbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7dbeabc66439c312baea476ecd244431afc91579', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7dbeabc66439c312baea476ecd244431afc91579', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e26c8fdaaaee3a3b6e5d3e1fbc6f2cbad8a48d07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e26c8fdaaaee3a3b6e5d3e1fbc6f2cbad8a48d07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2ebfc46d2b32179ff7a95325b0c9462ab9ca38c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2ebfc46d2b32179ff7a95325b0c9462ab9ca38c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7d7f0a892d74c0b3daf376ebec8a98cb70648a7a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7d7f0a892d74c0b3daf376ebec8a98cb70648a7a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:218fc8f5ed327c69acde89195db386665a8005f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:218fc8f5ed327c69acde89195db386665a8005f4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ebae90aea0d88386a9ea2d63ff1970e49f01adb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ebae90aea0d88386a9ea2d63ff1970e49f01adb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:245717b741ca0c705f4a9d7ab20c217e0b14c516', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:245717b741ca0c705f4a9d7ab20c217e0b14c516', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f9ad8d5c6a7d1172802d552ce15bdda08a4d612d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f9ad8d5c6a7d1172802d552ce15bdda08a4d612d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:830f40badff5e7b1e6cfc74c39cbe63fc20968dd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:830f40badff5e7b1e6cfc74c39cbe63fc20968dd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3380f02ef196a51686a80335340b7edb0813b63a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3380f02ef196a51686a80335340b7edb0813b63a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f767a9a01c2e14b599d9bffe4c7ef3e357c8879d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f767a9a01c2e14b599d9bffe4c7ef3e357c8879d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:061c35c7f6f9c12652bc29d8d37de325277093c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:061c35c7f6f9c12652bc29d8d37de325277093c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7542e0b803fd4d71f797a289e7e5ae1b4d45a4fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7542e0b803fd4d71f797a289e7e5ae1b4d45a4fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d77aa5bf7017db625b2310f3ba5d19c8835eca2b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d77aa5bf7017db625b2310f3ba5d19c8835eca2b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e9b3ada3f2bca6515bc37e61bb5f795c37a336c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e9b3ada3f2bca6515bc37e61bb5f795c37a336c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:195fdfa500d02abc8068c8e215ad2c07c3e13117', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:195fdfa500d02abc8068c8e215ad2c07c3e13117', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d4ffeaa6e998700595e3167a8d2a17bf5a732af4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d4ffeaa6e998700595e3167a8d2a17bf5a732af4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a6041359810dee8437aaaea8153205b49667dcc1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a6041359810dee8437aaaea8153205b49667dcc1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:701c3975016657c5c59a10dbebe3055387bfdae2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:701c3975016657c5c59a10dbebe3055387bfdae2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4845d6a5cf03f888043849c027e8b99e48c89232', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4845d6a5cf03f888043849c027e8b99e48c89232', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:65316da0d0633444a212dbf4f2b3cf0d96dded13', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:65316da0d0633444a212dbf4f2b3cf0d96dded13', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:de861510c88b7b2456b1b93d7503acfe4c5bc00c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de861510c88b7b2456b1b93d7503acfe4c5bc00c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0ec48259623a8cae8f58ccd75404a47ed005459c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0ec48259623a8cae8f58ccd75404a47ed005459c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:64b9f0c275ee84d37a35e49105864fd1329586e6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64b9f0c275ee84d37a35e49105864fd1329586e6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:18850b89fcb0c023e8d4dd9fc9d385ec11c6106c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18850b89fcb0c023e8d4dd9fc9d385ec11c6106c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a8370d37b810a34927ccdebd185b04c09617b031', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a8370d37b810a34927ccdebd185b04c09617b031', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7dab4f85a74fe68b7e6e3b78fb25630a8b0e7ad5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7dab4f85a74fe68b7e6e3b78fb25630a8b0e7ad5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dea418f4c2e5841a57cf28e907604dd32975dee8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dea418f4c2e5841a57cf28e907604dd32975dee8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a0511b55fd99820ec919687edbe91d7b2086bf41', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a0511b55fd99820ec919687edbe91d7b2086bf41', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95618946c89b49bc75f2e281ee58f43af7222f4b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95618946c89b49bc75f2e281ee58f43af7222f4b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:de849ba1252c88d86e00d7e1061d768e1f18656f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de849ba1252c88d86e00d7e1061d768e1f18656f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:69b6bbe8aaf811452ed03dbc346e3acfb5844582', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:69b6bbe8aaf811452ed03dbc346e3acfb5844582', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b2c8ecf289dffcac838dff03376b9eb343fd91f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0b2c8ecf289dffcac838dff03376b9eb343fd91f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d303a55d15238501693f9593d7f2fb87a5aa9191', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d303a55d15238501693f9593d7f2fb87a5aa9191', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aa2e8e34aec6d8fef771e01431b23800ceb403c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aa2e8e34aec6d8fef771e01431b23800ceb403c3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0c9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b3b93fa852d182300ce0e89ea890504b3e68a199', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b3b93fa852d182300ce0e89ea890504b3e68a199', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:824bdd02ffa2d49e8d4e54e88a19982c5494d55c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:824bdd02ffa2d49e8d4e54e88a19982c5494d55c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:507228074dd5fafc022725b6dfc0af96a3be9209', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:507228074dd5fafc022725b6dfc0af96a3be9209', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:59c05b66e6fbeb1fe826c90cef60a0bd9e9d9c54', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59c05b66e6fbeb1fe826c90cef60a0bd9e9d9c54', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c1ef6cc1d8b0594582e1f4e9e0484d398a26bc28', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c1ef6cc1d8b0594582e1f4e9e0484d398a26bc28', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ca9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b564a4f9c0cb6fa43fb390142966f82c22675659', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b564a4f9c0cb6fa43fb390142966f82c22675659', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ce8ec0a628bbba97d99103f4a616c3c830b1d3f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ce8ec0a628bbba97d99103f4a616c3c830b1d3f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6c7d8330e4e0ca5ea99b251de4b5befb2e37c4a1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0caf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c7d8330e4e0ca5ea99b251de4b5befb2e37c4a1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0caf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b45f9498298d7271e2a6e884129bf32787bbceb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0b45f9498298d7271e2a6e884129bf32787bbceb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:581638163226aeaec24516011c0cf3b52c350485', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:581638163226aeaec24516011c0cf3b52c350485', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:404bdd30c0b88731e0d11df3c3e9f82b8d79c8d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:404bdd30c0b88731e0d11df3c3e9f82b8d79c8d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:54001cfce53cad3d5df9aef1a42e80d74ca830f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:54001cfce53cad3d5df9aef1a42e80d74ca830f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e368764fde312bc4c63d1e471d7077a61dd9fb2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e368764fde312bc4c63d1e471d7077a61dd9fb2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:af5433ab6fd79d514aed1b8930579442e8055304', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:af5433ab6fd79d514aed1b8930579442e8055304', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:47e7ae3c23938d5a43cd4aa3105c88691e41bd8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cbc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47e7ae3c23938d5a43cd4aa3105c88691e41bd8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cbc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0186d1d8f552a05eb1830e500ef18bd0de683cdb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cbf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0186d1d8f552a05eb1830e500ef18bd0de683cdb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cbf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dd887eb22b7ccb074ad255a79ac11fa5cfcbec4b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd887eb22b7ccb074ad255a79ac11fa5cfcbec4b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:38fd4f350b22437156b859fe60b53f0a05ee13f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:38fd4f350b22437156b859fe60b53f0a05ee13f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:12a7d35f8f36f49e0fd9ed9a9d0d11a846a552e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:12a7d35f8f36f49e0fd9ed9a9d0d11a846a552e5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b20b716d18c984898a4da464341d90b7dc82563e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b20b716d18c984898a4da464341d90b7dc82563e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fa570656a546337879089b712c29389166b74393', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa570656a546337879089b712c29389166b74393', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5e1161b1dfcad44592d431100679ea870dd4f6d4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5e1161b1dfcad44592d431100679ea870dd4f6d4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cc9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9b3320100249969296d14664d720ee1e824f47b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ccb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b3320100249969296d14664d720ee1e824f47b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ccb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4b48c71c894bcebbb2aadc830c2f14a97ed441fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ccf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4b48c71c894bcebbb2aadc830c2f14a97ed441fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ccf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0c85441ab7a3307b6503479a8dd3563cda119465', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c85441ab7a3307b6503479a8dd3563cda119465', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:caabd7f2b75471b10ed81f99fd3dc2b24eb7dbaa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:caabd7f2b75471b10ed81f99fd3dc2b24eb7dbaa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1d2b050d65f3cf098ac300a432ddee86d2f56ed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1d2b050d65f3cf098ac300a432ddee86d2f56ed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b4a1ed854a45fdd97e738f1eb77827087574745c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b4a1ed854a45fdd97e738f1eb77827087574745c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f8288793837d18093e4dfe9534a2af42a88ad3f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8288793837d18093e4dfe9534a2af42a88ad3f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e5c22be38198022abd7ee11869dd28476b0d31f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cdb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e5c22be38198022abd7ee11869dd28476b0d31f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cdb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6137ed790380ca4dc93ef59671236ea1ddfa7541', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cde', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6137ed790380ca4dc93ef59671236ea1ddfa7541', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cde', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:48369d6c87f787afb2c983ef29cacbcf3a9d6874', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:48369d6c87f787afb2c983ef29cacbcf3a9d6874', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f59713e53ca6d5e896c6fb537eb3eaca2dbaf326', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f59713e53ca6d5e896c6fb537eb3eaca2dbaf326', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:54bf069c6937607810a5e2f34f1b47a3922651e2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:54bf069c6937607810a5e2f34f1b47a3922651e2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:40d373e519a8b3bfb17aa0b2bae3138a2694119f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:40d373e519a8b3bfb17aa0b2bae3138a2694119f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bde3da32e8e37eea7345552133b8f66447705d1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bde3da32e8e37eea7345552133b8f66447705d1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b832f8bea0bfdfed434d73354c3af81254a7afc0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b832f8bea0bfdfed434d73354c3af81254a7afc0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0364e6edcfce7ccadd9d433a683c18c7b9208e55', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0364e6edcfce7ccadd9d433a683c18c7b9208e55', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3ab1413ff05b3ea12d3d01ae03d0bc8573b3a142', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ab1413ff05b3ea12d3d01ae03d0bc8573b3a142', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ce9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a1701e5017f86146018c6ae902ceaf083f6d7093', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ceb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a1701e5017f86146018c6ae902ceaf083f6d7093', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0ceb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ddc7dc6c7d1217b354dcf9e31c89ffb78f1a6a7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ddc7dc6c7d1217b354dcf9e31c89ffb78f1a6a7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e67e6058e4798cfd377ec7f5ac007faaefad0ff', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e67e6058e4798cfd377ec7f5ac007faaefad0ff', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d7e8539fc4f15906711e8102b2d370e741a7f2a1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d7e8539fc4f15906711e8102b2d370e741a7f2a1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:23e7df1ede80cf1af7bcb9af878dc083a293179d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:23e7df1ede80cf1af7bcb9af878dc083a293179d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d2820b60441770a205243d8fc744e44569c7dcb1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d2820b60441770a205243d8fc744e44569c7dcb1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4d69bb7185cf6cda3997258b35af5d034fe4a156', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d69bb7185cf6cda3997258b35af5d034fe4a156', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3637a9f3432e435a7035efa4491f0bd719ed47d0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3637a9f3432e435a7035efa4491f0bd719ed47d0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cf9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:90a50f9e564a921852e58004e73e449e0840fc79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cfb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:90a50f9e564a921852e58004e73e449e0840fc79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cfb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1a14ad610ed42a45abebd87f5b663c807b2090c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a14ad610ed42a45abebd87f5b663c807b2090c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4e3b3a7bd83c662545c508f62fe50beaa0d8c83b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4e3b3a7bd83c662545c508f62fe50beaa0d8c83b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0cff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2ab4844c96654298ecbf2f229198e1bd4841e6f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2ab4844c96654298ecbf2f229198e1bd4841e6f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9797babe690b502100882a8df26ba560f59b9f02', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9797babe690b502100882a8df26ba560f59b9f02', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3414bf5741f19badcbb287626f4e6389d154ad51', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3414bf5741f19badcbb287626f4e6389d154ad51', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e4351b2059fbe3b77a639afc9aea29727a7d038', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e4351b2059fbe3b77a639afc9aea29727a7d038', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d67ca99a63ef37dcdb1cfd0310e7ba7166513d1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d67ca99a63ef37dcdb1cfd0310e7ba7166513d1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6fd45d99d437895a3e7715cc9baedc9f3ad1c87b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6fd45d99d437895a3e7715cc9baedc9f3ad1c87b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b7170761139d10f084da0860830c68b10dcdf58', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0b7170761139d10f084da0860830c68b10dcdf58', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3ca8d89177568a3942511db0641cd8d3a1bd2735', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ca8d89177568a3942511db0641cd8d3a1bd2735', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:873551722b01e853a9015b48945ef9f2e6b052fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:873551722b01e853a9015b48945ef9f2e6b052fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a6c84d506f237fbcc16dae38006ee50c66e91cbf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a6c84d506f237fbcc16dae38006ee50c66e91cbf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f30cea21d5836b8633424e85c4ab84b163e0898f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f30cea21d5836b8633424e85c4ab84b163e0898f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f217d283916cb2c14c8675eb6d6e6902d07b15dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f217d283916cb2c14c8675eb6d6e6902d07b15dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d88736f628a4346ebf032602b26b99a85ad7c620', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d88736f628a4346ebf032602b26b99a85ad7c620', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d2cb88d69fe333ea2b8462e3248be4b341e852ba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d2cb88d69fe333ea2b8462e3248be4b341e852ba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1cfe95047d8b8c0943648ae501e1a71eb22df8a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1cfe95047d8b8c0943648ae501e1a71eb22df8a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fab37a8ed1c4a61e98a5a042c41cca85430fef32', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fab37a8ed1c4a61e98a5a042c41cca85430fef32', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ea428c1cb1dec52dcbf314a88deedd07e4cba1e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ea428c1cb1dec52dcbf314a88deedd07e4cba1e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:369da9e46a3062d7bb1afafb78a6df0246ad9c80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:369da9e46a3062d7bb1afafb78a6df0246ad9c80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:eef8a79c60c65d6fd60e6464b5ae780e1c8ef00e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eef8a79c60c65d6fd60e6464b5ae780e1c8ef00e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e9b60a2696f637ce7f75395596b41095401150a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e9b60a2696f637ce7f75395596b41095401150a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2cd4b209bde30f051cd8b81b626c8b7dc4411fac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2cd4b209bde30f051cd8b81b626c8b7dc4411fac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:93c99082c0bcead8c759dcb8bcea3382da536d7c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93c99082c0bcead8c759dcb8bcea3382da536d7c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e594dc8f2f6f2509978e3ac907afcbe7ec448c34', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e594dc8f2f6f2509978e3ac907afcbe7ec448c34', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b37bf38c2ed1e1b2f387e665058be23143e272b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b37bf38c2ed1e1b2f387e665058be23143e272b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f7829e72ae00e86c5b71a5cbe4ddd98585234c93', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f7829e72ae00e86c5b71a5cbe4ddd98585234c93', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2dc3a1942096fedc6dfe46ff22e49076333bfe61', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2dc3a1942096fedc6dfe46ff22e49076333bfe61', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d13ef3ca7f190d002af39287fdf560b2eed30833', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d13ef3ca7f190d002af39287fdf560b2eed30833', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9c9fcd3a181cb76eadc47b2ccfcc76c6f44f1a95', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c9fcd3a181cb76eadc47b2ccfcc76c6f44f1a95', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8d23c7055599bbd7f5aecb49a7fa286022047db9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d23c7055599bbd7f5aecb49a7fa286022047db9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b15a2c86e0e5404ac3753d1532bc4484d87fe35c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b15a2c86e0e5404ac3753d1532bc4484d87fe35c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:66df703fec490b0249a6ff060561a5809c50bc91', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66df703fec490b0249a6ff060561a5809c50bc91', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c834db1753f56807aab3ea4ff8805800d9db53c5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c834db1753f56807aab3ea4ff8805800d9db53c5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c41f14b4f95675016ee414e787da516cb2252818', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c41f14b4f95675016ee414e787da516cb2252818', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c1bc3f5b58f433e85e9621ed81ee017d79ce5ca5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c1bc3f5b58f433e85e9621ed81ee017d79ce5ca5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5af3d0ce77e5030128f0f177c6b35262c17dee33', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5af3d0ce77e5030128f0f177c6b35262c17dee33', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:27c02279c2ed0915687c1da30a7b693712845668', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:27c02279c2ed0915687c1da30a7b693712845668', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:535a2a7ee8d2addc22b108f6dfb9d8ded2d0222c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:535a2a7ee8d2addc22b108f6dfb9d8ded2d0222c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3cbbc887cf07cb53d6d9e739129d9e00778d8970', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3cbbc887cf07cb53d6d9e739129d9e00778d8970', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1b7b88d9ec10679504a8b4e5d24447fb95631245', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1b7b88d9ec10679504a8b4e5d24447fb95631245', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b4686a88b298549535f9f55ea49db6d52b3b650b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b4686a88b298549535f9f55ea49db6d52b3b650b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:db69de7805c39ecfc463d8b90a4dbcf83b75baa5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:db69de7805c39ecfc463d8b90a4dbcf83b75baa5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:41d8ef071751c4cff5965f977b86d802a267e7d0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:41d8ef071751c4cff5965f977b86d802a267e7d0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:22dbedc6498f7ae60a6608467acea3dcdca68483', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:22dbedc6498f7ae60a6608467acea3dcdca68483', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2346f60646a1a51de68cb35666e660fc2f84e664', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2346f60646a1a51de68cb35666e660fc2f84e664', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ee5a36e0c0f7089f42795517055602e189ce6a8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee5a36e0c0f7089f42795517055602e189ce6a8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7be7e3bb816041f6efe3e40115c267da52412b99', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7be7e3bb816041f6efe3e40115c267da52412b99', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0be91c0d371878312506e329b5c0e7c2b94968cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0be91c0d371878312506e329b5c0e7c2b94968cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a05c865c0b5a2ff4a709c5842e5f3c7bcda1ba67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a05c865c0b5a2ff4a709c5842e5f3c7bcda1ba67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:05abcc256e4d929368ec4fcc5466d2606a70a022', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:05abcc256e4d929368ec4fcc5466d2606a70a022', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0629c9b0c1ccc488ebddb40ae845c70e59a3dfb2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0629c9b0c1ccc488ebddb40ae845c70e59a3dfb2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1c05635185f5eb72b4d7da30e6a5ea188ff2ea24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1c05635185f5eb72b4d7da30e6a5ea188ff2ea24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2323f23a2f876537fdc99d808460f15ce3a3b9cd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2323f23a2f876537fdc99d808460f15ce3a3b9cd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:69ebbfdc79fab3e7d8b983b2011e03d301933f1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:69ebbfdc79fab3e7d8b983b2011e03d301933f1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e5c12fe627c3d47d5f4bb78d504456e63d84d554', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e5c12fe627c3d47d5f4bb78d504456e63d84d554', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1239af89f4a87c795ab5beacee7f5ef16febfa3b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1239af89f4a87c795ab5beacee7f5ef16febfa3b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0100716d7fd856e8a4db0d228c10b41672a1fc67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0100716d7fd856e8a4db0d228c10b41672a1fc67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a9742b17b83abaf248ed8d2471840a49f5a2219d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a9742b17b83abaf248ed8d2471840a49f5a2219d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a9a6c446a5a9efdec03dc8e4fd6afb6fa2a037e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a9a6c446a5a9efdec03dc8e4fd6afb6fa2a037e4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f6e9be92fbf94d93f2fd827214db6414130105d9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f6e9be92fbf94d93f2fd827214db6414130105d9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fc7facfc09bb44735177dfefed99d3aef48b2c46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc7facfc09bb44735177dfefed99d3aef48b2c46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aeba79dd0404e790e0ab499b0a98980f0addcbd6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aeba79dd0404e790e0ab499b0a98980f0addcbd6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d9888700db9b1968a8f0f7091b65a318aedc3d9c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9888700db9b1968a8f0f7091b65a318aedc3d9c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.032789] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.040715] Modules linked in:\n[    4.043780] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.051525] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.060654] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.065107] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.083855] RSP: 0018:ffffa2bb80033b30 EFLAGS: 00010246\n[    4.089084] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    4.096215] RDX: ffffa2bb80033b38 RSI: 0000000000000001 RDI: ffffa2bb80033b80\n[    4.103345] RBP: ffff8b6f839b88e8 R08: ffff8b6f839af6f0 R09: ffff8b6f836db000\n[    4.110477] R10: 0000000000000040 R11: ffffffffa7c58840 R12: ffff8b6f83980000\n[    4.117610] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.124739] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    4.132827] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.138572] CR2: 00007f226cf3b160 CR3: 000000010ce2e000 CR4: 00000000003506f0\n[    4.145704] Call Trace:\n[    4.148158]  <TASK>\n[    4.150262]  ? __warn+0x84/0x130\n[    4.153493]  ? __flush_work+0x2d6/0x300\n[    4.157333]  ? report_bug+0x164/0x190\n[    4.161002]  ? handle_bug+0x54/0x90\n[    4.164495]  ? exc_invalid_op+0x17/0x70\n[    4.168335]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.172524]  ? __flush_work+0x2d6/0x300\n[    4.176366]  cancel_delayed_work_sync+0x5c/0x80\n[    4.180897]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.185431]  amdgpu_ring_alloc+0x3e/0x60\n[    4.189361]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.194500]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.198946]  amdgpu_device_init+0x1e4f/0x2530\n[    4.203309]  amdgpu_driver_load_kms+0x14/0x80\n[    4.207668]  amdgpu_pci_probe+0x150/0x490\n[    4.211682]  local_pci_probe+0x3d/0x90\n[    4.215435]  pci_device_probe+0xb5/0x180\n[    4.219364]  really_probe+0xcc/0x2b0\n[    4.222942]  ? __pfx___driver_attach+0x10/0x10\n[    4.227387]  __driver_probe_device+0x6e/0x110\n[    4.231745]  driver_probe_device+0x1a/0xe0\n[    4.235846]  __driver_attach+0x83/0x180\n[    4.239685]  bus_for_each_dev+0x83/0xd0\n[    4.243526]  bus_add_driver+0xe3/0x210\n[    4.247271]  driver_register+0x54/0x100\n[    4.251110]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.255214]  do_one_initcall+0x56/0x220\n[    4.259055]  kernel_init_freeable+0x19e/0x2d0\n[    4.263417]  ? __pfx_kernel_init+0x10/0x10\n[    4.267517]  kernel_init+0x15/0x1c0\n[    4.271010]  ret_from_fork+0x2f/0x50\n[    4.274588]  ? __pfx_kernel_init+0x10/0x10\n[    4.278688]  ret_from_fork_asm+0x1a/0x30\n[    4.282619]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_memops', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.446679] WARNING: CPU: 0 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.454686] Modules linked in: btusb btrtl cros_ec_lid_angle cros_ec_sensors btintel cros_ec_sensors_core btbcm btmtk bluetooth cros_ec_hwmon cros_ec_sysfs cros_ec_chardev cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger cros_charge_control cros_ec_sensorhub snd_acp3x_pcm_dma snd_acp3x_i2s snd_soc_rt5682_i2c snd_soc_acp_rt5682_mach snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_soc_rt5682 gsmi snd_sof_pci rtw88_8822ce snd_soc_acp_da7219mx98357_mach snd_sof_xtensa_dsp snd_soc_rl6231 sp5100_tco watchdog regmap_i2c rtw88_8822c acp_audio_dma cros_ec_typec snd_sof acpi_als snd_sof_utils memconsole_coreboot snd_soc_acpi rtw88_pci industrialio_triggered_buffer snd_soc_max98357a i2c_piix4 roles snd_soc_cros_ec_codec snd_pci_acp3x cros_ec_dev kfifo_buf rtw88_core vpd_sysfs memconsole typec cros_usbpd_notify i2c_cros_ec_tunnel industrialio snd_soc_core i2c_hid_acpi elan_i2c snd_compress i2c_hid snd_pcm_dmaengine chromeos_pstore coreboot_table uvcvideo videobuf2_vmalloc videobuf2_memops uvc\n[    6.454810]  videobuf2_v4l2 videobuf2_common\n[    6.548566] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.558044] Tainted: [W]=WARN\n[    6.561016] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.570144] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.576586] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.581037] Code: 70 9e 97 5b 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.599786] RSP: 0018:ffffa2bb80263c70 EFLAGS: 00010246\n[    6.605012] RAX: 0000000000000000 RBX: ffff8b6f839b88e8 RCX: 0000000000000000\n[    6.612148] RDX: ffffa2bb80263c78 RSI: 0000000000000001 RDI: ffffa2bb80263cc0\n[    6.619282] RBP: ffff8b6f839b88e8 R08: ffffa2bb80263df0 R09: 0000000000000000\n[    6.626417] R10: ffffa2bb80263b38 R11: 0000000000039321 R12: 00000000000003e8\n[    6.633550] R13: 0000000000000001 R14: ffff8b6f83980000 R15: ffff8b6f839b23c0\n[    6.640692] FS:  0000000000000000(0000) GS:ffff8b6fab000000(0000) knlGS:0000000000000000\n[    6.648780] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.654526] CR2: 00007ffccf88bc58 CR3: 0000000105388000 CR4: 00000000003506f0\n[    6.661660] Call Trace:\n[    6.664111]  <TASK>\n[    6.666216]  ? __warn+0x84/0x130\n[    6.669453]  ? __flush_work+0x2d6/0x300\n[    6.673299]  ? report_bug+0x164/0x190\n[    6.676973]  ? handle_bug+0x54/0x90\n[    6.680468]  ? exc_invalid_op+0x17/0x70\n[    6.684309]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.688502]  ? __flush_work+0x2d6/0x300\n[    6.692350]  cancel_delayed_work_sync+0x5c/0x80\n[    6.696889]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.701425]  amdgpu_ring_alloc+0x3e/0x60\n[    6.705353]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.709459]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.713993]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.718966]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.723327]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.729161]  process_one_work+0x163/0x390\n[    6.733175]  worker_thread+0x2a0/0x3b0\n[    6.736932]  ? __pfx_worker_thread+0x10/0x10\n[    6.741207]  ? __pfx_worker_thread+0x10/0x10\n[    6.745481]  kthread+0xcb/0xf0\n[    6.748543]  ? __pfx_kthread+0x10/0x10\n[    6.752297]  ret_from_fork+0x2f/0x50\n[    6.755881]  ? __pfx_kthread+0x10/0x10\n[    6.759633]  ret_from_fork_asm+0x1a/0x30\n[    6.763566]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7cecb791935a2da4dd17e1530951398e5c11d46c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7cecb791935a2da4dd17e1530951398e5c11d46c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e7d11fb139cb87e0d89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1111fb139cb87dfaba
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bbd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bbe
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bbf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bc9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bca
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bcb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bcc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bcd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bcf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bdb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bdf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bea
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bec
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bee
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bfa
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bfd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bff
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c01
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c03
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c05
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c06
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c08
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c10
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c12
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c14
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c16
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c18
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c20
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c22
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c24
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c26
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c28
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c31
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c33
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c35
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c37
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c39
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c42
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c44
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c46
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c47
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c49
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c4d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c4f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c52
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c54
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c56
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c58
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c5b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c5e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c60
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c61
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c63
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c65
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c68
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c70
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c72
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c74
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c75
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c78
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c79
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c80
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c82
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c83
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c85
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c89
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c92
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c94
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c96
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c99
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cac
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cad
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0caf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cba
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cbc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cbf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ccb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ccf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cdb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cde
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ceb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cec
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cef
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cfb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cfd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cff
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d01
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d03
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d05
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d07
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d09
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d11
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d13
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d18
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d22
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d24
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d26
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d28
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d29
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d32
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d34
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d36
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d38
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d48
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d49
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d51
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d53
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d55
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d57
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d59
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d61
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d63
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d65
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d69
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d71
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d73
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d75
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d77
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d79
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d82
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d83
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d84
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d85
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d86
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d87
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d88
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d89
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d8a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:267de0b96923394b6e74f389350a78cfd9ac3f30
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:267de0b96923394b6e74f389350a78cfd9ac3f30
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48dac77097292ffc7f40dd1b907dabb58d9ec749
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48dac77097292ffc7f40dd1b907dabb58d9ec749
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1ded3b93e8a17ae6c8847d19db47f13fea2796d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1ded3b93e8a17ae6c8847d19db47f13fea2796d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac161ae03e51608fd1150190f211621441773c85
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac161ae03e51608fd1150190f211621441773c85
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ad45bb07e0c330d032d3344651e4d6420c66054
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ad45bb07e0c330d032d3344651e4d6420c66054
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1108332eb6d2dbf895e24b6ddd151611f80b993
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1108332eb6d2dbf895e24b6ddd151611f80b993
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b67c868f4c334f020ae5508aed7d422540f95b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b67c868f4c334f020ae5508aed7d422540f95b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a8c3b6068e1016bd115fd1170d610949cdfaf158
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a8c3b6068e1016bd115fd1170d610949cdfaf158
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9be079efbb1b0757f282e9dd44512fc11c0804dc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9be079efbb1b0757f282e9dd44512fc11c0804dc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5aca677a130cba71cb8865a625ebe5326715dca9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5aca677a130cba71cb8865a625ebe5326715dca9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f10d732587d8ec08d8f392006c76b37fd5373734
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f10d732587d8ec08d8f392006c76b37fd5373734
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d3028c458033fe368e21783348f4c804f07b799
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d3028c458033fe368e21783348f4c804f07b799
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:954602c6f6c423b9ec98548afabc2937d592d8c2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:954602c6f6c423b9ec98548afabc2937d592d8c2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e5ca8b6f23c1067b9f9ea605e6d1388366a1c00
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e5ca8b6f23c1067b9f9ea605e6d1388366a1c00
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e876baa5abb21bdaa7de077e0da3fe7b19a930a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e876baa5abb21bdaa7de077e0da3fe7b19a930a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4891ff7e1fa9936b404f70e68f5ed998aaf9f9f0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4891ff7e1fa9936b404f70e68f5ed998aaf9f9f0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cfc8f404e30fdf9a3175dc25d6e2df53b9c9ccc3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cfc8f404e30fdf9a3175dc25d6e2df53b9c9ccc3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:449956f071324efcdf11fc6a90cbb1f042586bb3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:449956f071324efcdf11fc6a90cbb1f042586bb3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc1e77d5a810692723066ec1e1360db7cf6fee5f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc1e77d5a810692723066ec1e1360db7cf6fee5f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8531a8d650a3ecb327c121cbec11624c2762a612
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8531a8d650a3ecb327c121cbec11624c2762a612
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:845a3e06dbd781df43e818ad54179928aba94041
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:845a3e06dbd781df43e818ad54179928aba94041
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95c4796229ba30736bee122cf6b305b46fd57a06
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95c4796229ba30736bee122cf6b305b46fd57a06
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8388e0aaadd9147ff22d47ec7413cc4ff113cac3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8388e0aaadd9147ff22d47ec7413cc4ff113cac3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d72b0b9df4130402627a1fba03ccdd663d7ed4b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d72b0b9df4130402627a1fba03ccdd663d7ed4b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65c214624686c4737b4f3b81f2700a188a4124b3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65c214624686c4737b4f3b81f2700a188a4124b3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3de04a8a5b62250fd10a9189bd0a8bbe2a3ae1e5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3de04a8a5b62250fd10a9189bd0a8bbe2a3ae1e5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ef10c83ee989925562e0dd7529ac64da440f100
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ef10c83ee989925562e0dd7529ac64da440f100
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99770da0ef68f668fb37cac0282d2e27a88fac0e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99770da0ef68f668fb37cac0282d2e27a88fac0e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ece6da4429223131b625c246900a9ff06af3465
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ece6da4429223131b625c246900a9ff06af3465
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03d47df06604fc04aac22949a913228dd9ef0a38
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03d47df06604fc04aac22949a913228dd9ef0a38
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fa3b376538a2dfe9431c581e3382e4dfc8dcea5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fa3b376538a2dfe9431c581e3382e4dfc8dcea5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21f833b55e95a58fac47d9fa9344dfa99cd7abf3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21f833b55e95a58fac47d9fa9344dfa99cd7abf3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30617516508834549f13b9ce3bde495f40371325
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30617516508834549f13b9ce3bde495f40371325
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a3e8ebbb6c96a0df8814ebd27cd52059aa48cf4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a3e8ebbb6c96a0df8814ebd27cd52059aa48cf4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f2bc978af39672dc77cd778ae1ccfb35f228c67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f2bc978af39672dc77cd778ae1ccfb35f228c67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9beff2714ff60b749d490d87f956535d18a54cee
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9beff2714ff60b749d490d87f956535d18a54cee
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e902c14514e2f030e2c490aabef32d970ede4d7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e902c14514e2f030e2c490aabef32d970ede4d7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a486f28643f7f15a41c20f394eedc6de9ff541d9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a486f28643f7f15a41c20f394eedc6de9ff541d9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12c865d02fa5102cd2b0cf8c7ce8096c6e6b4160
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12c865d02fa5102cd2b0cf8c7ce8096c6e6b4160
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:273242853756a672042e4d89f5ae28736e0079c1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:273242853756a672042e4d89f5ae28736e0079c1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9a0562c089e73ea9c8625b3625e164671d547be
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9a0562c089e73ea9c8625b3625e164671d547be
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be3469c0a598fc9fcdecabc32909991fe5a2795e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be3469c0a598fc9fcdecabc32909991fe5a2795e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63a3a122c355e5276135c8cc194676ee244cecfd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63a3a122c355e5276135c8cc194676ee244cecfd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4a1b3c20bd82133f6a60563755c404073de2a50
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4a1b3c20bd82133f6a60563755c404073de2a50
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:675667115fcd6923fdce4708478c7b53522cfb35
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:675667115fcd6923fdce4708478c7b53522cfb35
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2771a3c1e5488a78a4369ee4b08bd5c234615c6d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2771a3c1e5488a78a4369ee4b08bd5c234615c6d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b23250a9a4518a66aff63ff0b5996af8f961e091
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b23250a9a4518a66aff63ff0b5996af8f961e091
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa48af53658bfa5b946f5a880e9619f334f168cf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa48af53658bfa5b946f5a880e9619f334f168cf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8c501f777b423a20905b8374b38ab41ff6cb0cb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8c501f777b423a20905b8374b38ab41ff6cb0cb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b21c2e4465127427ae2551a0a8c060c2b5047421
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b21c2e4465127427ae2551a0a8c060c2b5047421
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee1ba10e23b159c99f60859a0bfe96f842971bfa
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee1ba10e23b159c99f60859a0bfe96f842971bfa
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d67378e8ef7fff47a3fcefe92e34e998e9d9fc5a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d67378e8ef7fff47a3fcefe92e34e998e9d9fc5a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:062bc71b4687418ad03939a35249f22d0d7ff7e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:062bc71b4687418ad03939a35249f22d0d7ff7e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:423d348f5be4f8a1c2e6e3368f203147751bcfc7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:423d348f5be4f8a1c2e6e3368f203147751bcfc7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:574467e8e4e716be120b7d0b53a02edb1484d528
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:574467e8e4e716be120b7d0b53a02edb1484d528
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c134ce6767506352407b502df651dd8053c0f047
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c134ce6767506352407b502df651dd8053c0f047
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e515666c526a958ea14316d0f355990bdf82b7f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e515666c526a958ea14316d0f355990bdf82b7f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f4b722dc722d49ccc9f33285fd4b8df71257680
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f4b722dc722d49ccc9f33285fd4b8df71257680
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c2ae828f7e9ddc525c5f002270c9dc2a59ec253
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c2ae828f7e9ddc525c5f002270c9dc2a59ec253
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:875df217dbc12c4d9e26cb90903bbc667cea111c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:875df217dbc12c4d9e26cb90903bbc667cea111c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0e98f4f34635cd2f5cc78b20845a1366932f869d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0e98f4f34635cd2f5cc78b20845a1366932f869d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:09ba0cc5ec423a3fe2eba0b413785450e2d9089b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:09ba0cc5ec423a3fe2eba0b413785450e2d9089b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5712007dc85d3adad9cab917a16fc2cbd7ba71ab
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5712007dc85d3adad9cab917a16fc2cbd7ba71ab
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5de74096d4f78ca71f3d47b00f9dc1c11b40fe2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5de74096d4f78ca71f3d47b00f9dc1c11b40fe2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46a612f8606169c106a21712e841cf1e6acb32b3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46a612f8606169c106a21712e841cf1e6acb32b3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0cccd14f2773653c4118c242f508d07e8a01a8f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0cccd14f2773653c4118c242f508d07e8a01a8f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d826e12216a8dc93540cfa494165cbbcbd1d0d74
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d826e12216a8dc93540cfa494165cbbcbd1d0d74
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e32a3ca2501c3ef1801ede133c74ab7e787472ee
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e32a3ca2501c3ef1801ede133c74ab7e787472ee
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71fef95dd76d27fd1671022059383b9afb3a9a8e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71fef95dd76d27fd1671022059383b9afb3a9a8e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:897f3e9d59a96706558eff67d1c2776ba40e7a1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:897f3e9d59a96706558eff67d1c2776ba40e7a1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fbcf305f8ad2df3a18900e33bff38216abdccbd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fbcf305f8ad2df3a18900e33bff38216abdccbd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dbeabc66439c312baea476ecd244431afc91579
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dbeabc66439c312baea476ecd244431afc91579
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e26c8fdaaaee3a3b6e5d3e1fbc6f2cbad8a48d07
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e26c8fdaaaee3a3b6e5d3e1fbc6f2cbad8a48d07
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ebfc46d2b32179ff7a95325b0c9462ab9ca38c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ebfc46d2b32179ff7a95325b0c9462ab9ca38c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d7f0a892d74c0b3daf376ebec8a98cb70648a7a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d7f0a892d74c0b3daf376ebec8a98cb70648a7a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:218fc8f5ed327c69acde89195db386665a8005f4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:218fc8f5ed327c69acde89195db386665a8005f4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ebae90aea0d88386a9ea2d63ff1970e49f01adb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ebae90aea0d88386a9ea2d63ff1970e49f01adb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:245717b741ca0c705f4a9d7ab20c217e0b14c516
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:245717b741ca0c705f4a9d7ab20c217e0b14c516
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9ad8d5c6a7d1172802d552ce15bdda08a4d612d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9ad8d5c6a7d1172802d552ce15bdda08a4d612d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:830f40badff5e7b1e6cfc74c39cbe63fc20968dd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:830f40badff5e7b1e6cfc74c39cbe63fc20968dd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3380f02ef196a51686a80335340b7edb0813b63a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3380f02ef196a51686a80335340b7edb0813b63a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f767a9a01c2e14b599d9bffe4c7ef3e357c8879d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f767a9a01c2e14b599d9bffe4c7ef3e357c8879d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:061c35c7f6f9c12652bc29d8d37de325277093c0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:061c35c7f6f9c12652bc29d8d37de325277093c0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7542e0b803fd4d71f797a289e7e5ae1b4d45a4fc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7542e0b803fd4d71f797a289e7e5ae1b4d45a4fc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d77aa5bf7017db625b2310f3ba5d19c8835eca2b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d77aa5bf7017db625b2310f3ba5d19c8835eca2b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e9b3ada3f2bca6515bc37e61bb5f795c37a336c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e9b3ada3f2bca6515bc37e61bb5f795c37a336c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:195fdfa500d02abc8068c8e215ad2c07c3e13117
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:195fdfa500d02abc8068c8e215ad2c07c3e13117
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d4ffeaa6e998700595e3167a8d2a17bf5a732af4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d4ffeaa6e998700595e3167a8d2a17bf5a732af4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6041359810dee8437aaaea8153205b49667dcc1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6041359810dee8437aaaea8153205b49667dcc1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:701c3975016657c5c59a10dbebe3055387bfdae2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:701c3975016657c5c59a10dbebe3055387bfdae2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4845d6a5cf03f888043849c027e8b99e48c89232
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4845d6a5cf03f888043849c027e8b99e48c89232
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65316da0d0633444a212dbf4f2b3cf0d96dded13
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65316da0d0633444a212dbf4f2b3cf0d96dded13
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de861510c88b7b2456b1b93d7503acfe4c5bc00c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de861510c88b7b2456b1b93d7503acfe4c5bc00c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ec48259623a8cae8f58ccd75404a47ed005459c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ec48259623a8cae8f58ccd75404a47ed005459c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64b9f0c275ee84d37a35e49105864fd1329586e6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64b9f0c275ee84d37a35e49105864fd1329586e6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18850b89fcb0c023e8d4dd9fc9d385ec11c6106c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18850b89fcb0c023e8d4dd9fc9d385ec11c6106c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a8370d37b810a34927ccdebd185b04c09617b031
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a8370d37b810a34927ccdebd185b04c09617b031
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dab4f85a74fe68b7e6e3b78fb25630a8b0e7ad5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dab4f85a74fe68b7e6e3b78fb25630a8b0e7ad5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dea418f4c2e5841a57cf28e907604dd32975dee8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dea418f4c2e5841a57cf28e907604dd32975dee8
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0511b55fd99820ec919687edbe91d7b2086bf41
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0511b55fd99820ec919687edbe91d7b2086bf41
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95618946c89b49bc75f2e281ee58f43af7222f4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95618946c89b49bc75f2e281ee58f43af7222f4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de849ba1252c88d86e00d7e1061d768e1f18656f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de849ba1252c88d86e00d7e1061d768e1f18656f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69b6bbe8aaf811452ed03dbc346e3acfb5844582
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69b6bbe8aaf811452ed03dbc346e3acfb5844582
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b2c8ecf289dffcac838dff03376b9eb343fd91f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b2c8ecf289dffcac838dff03376b9eb343fd91f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d303a55d15238501693f9593d7f2fb87a5aa9191
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d303a55d15238501693f9593d7f2fb87a5aa9191
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa2e8e34aec6d8fef771e01431b23800ceb403c3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa2e8e34aec6d8fef771e01431b23800ceb403c3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3b93fa852d182300ce0e89ea890504b3e68a199
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3b93fa852d182300ce0e89ea890504b3e68a199
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:824bdd02ffa2d49e8d4e54e88a19982c5494d55c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:824bdd02ffa2d49e8d4e54e88a19982c5494d55c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:507228074dd5fafc022725b6dfc0af96a3be9209
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:507228074dd5fafc022725b6dfc0af96a3be9209
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59c05b66e6fbeb1fe826c90cef60a0bd9e9d9c54
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59c05b66e6fbeb1fe826c90cef60a0bd9e9d9c54
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1ef6cc1d8b0594582e1f4e9e0484d398a26bc28
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1ef6cc1d8b0594582e1f4e9e0484d398a26bc28
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b564a4f9c0cb6fa43fb390142966f82c22675659
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b564a4f9c0cb6fa43fb390142966f82c22675659
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ce8ec0a628bbba97d99103f4a616c3c830b1d3f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ce8ec0a628bbba97d99103f4a616c3c830b1d3f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c7d8330e4e0ca5ea99b251de4b5befb2e37c4a1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c7d8330e4e0ca5ea99b251de4b5befb2e37c4a1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b45f9498298d7271e2a6e884129bf32787bbceb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b45f9498298d7271e2a6e884129bf32787bbceb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:581638163226aeaec24516011c0cf3b52c350485
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:581638163226aeaec24516011c0cf3b52c350485
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:404bdd30c0b88731e0d11df3c3e9f82b8d79c8d3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:404bdd30c0b88731e0d11df3c3e9f82b8d79c8d3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54001cfce53cad3d5df9aef1a42e80d74ca830f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54001cfce53cad3d5df9aef1a42e80d74ca830f9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e368764fde312bc4c63d1e471d7077a61dd9fb2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e368764fde312bc4c63d1e471d7077a61dd9fb2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af5433ab6fd79d514aed1b8930579442e8055304
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af5433ab6fd79d514aed1b8930579442e8055304
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47e7ae3c23938d5a43cd4aa3105c88691e41bd8d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47e7ae3c23938d5a43cd4aa3105c88691e41bd8d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0186d1d8f552a05eb1830e500ef18bd0de683cdb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0186d1d8f552a05eb1830e500ef18bd0de683cdb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd887eb22b7ccb074ad255a79ac11fa5cfcbec4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd887eb22b7ccb074ad255a79ac11fa5cfcbec4b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38fd4f350b22437156b859fe60b53f0a05ee13f0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38fd4f350b22437156b859fe60b53f0a05ee13f0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12a7d35f8f36f49e0fd9ed9a9d0d11a846a552e5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12a7d35f8f36f49e0fd9ed9a9d0d11a846a552e5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b20b716d18c984898a4da464341d90b7dc82563e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b20b716d18c984898a4da464341d90b7dc82563e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa570656a546337879089b712c29389166b74393
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa570656a546337879089b712c29389166b74393
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e1161b1dfcad44592d431100679ea870dd4f6d4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e1161b1dfcad44592d431100679ea870dd4f6d4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b3320100249969296d14664d720ee1e824f47b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b3320100249969296d14664d720ee1e824f47b6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b48c71c894bcebbb2aadc830c2f14a97ed441fc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b48c71c894bcebbb2aadc830c2f14a97ed441fc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c85441ab7a3307b6503479a8dd3563cda119465
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c85441ab7a3307b6503479a8dd3563cda119465
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:caabd7f2b75471b10ed81f99fd3dc2b24eb7dbaa
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:caabd7f2b75471b10ed81f99fd3dc2b24eb7dbaa
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1d2b050d65f3cf098ac300a432ddee86d2f56ed
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1d2b050d65f3cf098ac300a432ddee86d2f56ed
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4a1ed854a45fdd97e738f1eb77827087574745c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4a1ed854a45fdd97e738f1eb77827087574745c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8288793837d18093e4dfe9534a2af42a88ad3f7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8288793837d18093e4dfe9534a2af42a88ad3f7
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e5c22be38198022abd7ee11869dd28476b0d31f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e5c22be38198022abd7ee11869dd28476b0d31f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6137ed790380ca4dc93ef59671236ea1ddfa7541
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6137ed790380ca4dc93ef59671236ea1ddfa7541
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48369d6c87f787afb2c983ef29cacbcf3a9d6874
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48369d6c87f787afb2c983ef29cacbcf3a9d6874
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f59713e53ca6d5e896c6fb537eb3eaca2dbaf326
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f59713e53ca6d5e896c6fb537eb3eaca2dbaf326
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54bf069c6937607810a5e2f34f1b47a3922651e2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54bf069c6937607810a5e2f34f1b47a3922651e2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40d373e519a8b3bfb17aa0b2bae3138a2694119f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40d373e519a8b3bfb17aa0b2bae3138a2694119f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bde3da32e8e37eea7345552133b8f66447705d1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bde3da32e8e37eea7345552133b8f66447705d1a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b832f8bea0bfdfed434d73354c3af81254a7afc0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b832f8bea0bfdfed434d73354c3af81254a7afc0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0364e6edcfce7ccadd9d433a683c18c7b9208e55
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0364e6edcfce7ccadd9d433a683c18c7b9208e55
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ab1413ff05b3ea12d3d01ae03d0bc8573b3a142
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ab1413ff05b3ea12d3d01ae03d0bc8573b3a142
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1701e5017f86146018c6ae902ceaf083f6d7093
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1701e5017f86146018c6ae902ceaf083f6d7093
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddc7dc6c7d1217b354dcf9e31c89ffb78f1a6a7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddc7dc6c7d1217b354dcf9e31c89ffb78f1a6a7d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e67e6058e4798cfd377ec7f5ac007faaefad0ff
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e67e6058e4798cfd377ec7f5ac007faaefad0ff
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7e8539fc4f15906711e8102b2d370e741a7f2a1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7e8539fc4f15906711e8102b2d370e741a7f2a1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23e7df1ede80cf1af7bcb9af878dc083a293179d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23e7df1ede80cf1af7bcb9af878dc083a293179d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2820b60441770a205243d8fc744e44569c7dcb1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2820b60441770a205243d8fc744e44569c7dcb1
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d69bb7185cf6cda3997258b35af5d034fe4a156
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d69bb7185cf6cda3997258b35af5d034fe4a156
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3637a9f3432e435a7035efa4491f0bd719ed47d0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3637a9f3432e435a7035efa4491f0bd719ed47d0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90a50f9e564a921852e58004e73e449e0840fc79
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90a50f9e564a921852e58004e73e449e0840fc79
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a14ad610ed42a45abebd87f5b663c807b2090c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a14ad610ed42a45abebd87f5b663c807b2090c9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e3b3a7bd83c662545c508f62fe50beaa0d8c83b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e3b3a7bd83c662545c508f62fe50beaa0d8c83b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ab4844c96654298ecbf2f229198e1bd4841e6f3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ab4844c96654298ecbf2f229198e1bd4841e6f3
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9797babe690b502100882a8df26ba560f59b9f02
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9797babe690b502100882a8df26ba560f59b9f02
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3414bf5741f19badcbb287626f4e6389d154ad51
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3414bf5741f19badcbb287626f4e6389d154ad51
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e4351b2059fbe3b77a639afc9aea29727a7d038
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e4351b2059fbe3b77a639afc9aea29727a7d038
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d67ca99a63ef37dcdb1cfd0310e7ba7166513d1e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d67ca99a63ef37dcdb1cfd0310e7ba7166513d1e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6fd45d99d437895a3e7715cc9baedc9f3ad1c87b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6fd45d99d437895a3e7715cc9baedc9f3ad1c87b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b7170761139d10f084da0860830c68b10dcdf58
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b7170761139d10f084da0860830c68b10dcdf58
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ca8d89177568a3942511db0641cd8d3a1bd2735
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ca8d89177568a3942511db0641cd8d3a1bd2735
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:873551722b01e853a9015b48945ef9f2e6b052fb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:873551722b01e853a9015b48945ef9f2e6b052fb
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6c84d506f237fbcc16dae38006ee50c66e91cbf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6c84d506f237fbcc16dae38006ee50c66e91cbf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f30cea21d5836b8633424e85c4ab84b163e0898f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f30cea21d5836b8633424e85c4ab84b163e0898f
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f217d283916cb2c14c8675eb6d6e6902d07b15dc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f217d283916cb2c14c8675eb6d6e6902d07b15dc
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d88736f628a4346ebf032602b26b99a85ad7c620
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d88736f628a4346ebf032602b26b99a85ad7c620
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2cb88d69fe333ea2b8462e3248be4b341e852ba
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2cb88d69fe333ea2b8462e3248be4b341e852ba
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1cfe95047d8b8c0943648ae501e1a71eb22df8a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1cfe95047d8b8c0943648ae501e1a71eb22df8a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fab37a8ed1c4a61e98a5a042c41cca85430fef32
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fab37a8ed1c4a61e98a5a042c41cca85430fef32
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea428c1cb1dec52dcbf314a88deedd07e4cba1e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea428c1cb1dec52dcbf314a88deedd07e4cba1e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:369da9e46a3062d7bb1afafb78a6df0246ad9c80
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:369da9e46a3062d7bb1afafb78a6df0246ad9c80
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eef8a79c60c65d6fd60e6464b5ae780e1c8ef00e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eef8a79c60c65d6fd60e6464b5ae780e1c8ef00e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e9b60a2696f637ce7f75395596b41095401150a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e9b60a2696f637ce7f75395596b41095401150a
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2cd4b209bde30f051cd8b81b626c8b7dc4411fac
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2cd4b209bde30f051cd8b81b626c8b7dc4411fac
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93c99082c0bcead8c759dcb8bcea3382da536d7c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93c99082c0bcead8c759dcb8bcea3382da536d7c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e594dc8f2f6f2509978e3ac907afcbe7ec448c34
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e594dc8f2f6f2509978e3ac907afcbe7ec448c34
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b37bf38c2ed1e1b2f387e665058be23143e272b0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b37bf38c2ed1e1b2f387e665058be23143e272b0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7829e72ae00e86c5b71a5cbe4ddd98585234c93
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7829e72ae00e86c5b71a5cbe4ddd98585234c93
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2dc3a1942096fedc6dfe46ff22e49076333bfe61
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2dc3a1942096fedc6dfe46ff22e49076333bfe61
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d13ef3ca7f190d002af39287fdf560b2eed30833
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d13ef3ca7f190d002af39287fdf560b2eed30833
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c9fcd3a181cb76eadc47b2ccfcc76c6f44f1a95
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c9fcd3a181cb76eadc47b2ccfcc76c6f44f1a95
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d23c7055599bbd7f5aecb49a7fa286022047db9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d23c7055599bbd7f5aecb49a7fa286022047db9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b15a2c86e0e5404ac3753d1532bc4484d87fe35c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b15a2c86e0e5404ac3753d1532bc4484d87fe35c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66df703fec490b0249a6ff060561a5809c50bc91
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66df703fec490b0249a6ff060561a5809c50bc91
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c834db1753f56807aab3ea4ff8805800d9db53c5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c834db1753f56807aab3ea4ff8805800d9db53c5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c41f14b4f95675016ee414e787da516cb2252818
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c41f14b4f95675016ee414e787da516cb2252818
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1bc3f5b58f433e85e9621ed81ee017d79ce5ca5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1bc3f5b58f433e85e9621ed81ee017d79ce5ca5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5af3d0ce77e5030128f0f177c6b35262c17dee33
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5af3d0ce77e5030128f0f177c6b35262c17dee33
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27c02279c2ed0915687c1da30a7b693712845668
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27c02279c2ed0915687c1da30a7b693712845668
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:535a2a7ee8d2addc22b108f6dfb9d8ded2d0222c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:535a2a7ee8d2addc22b108f6dfb9d8ded2d0222c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cbbc887cf07cb53d6d9e739129d9e00778d8970
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cbbc887cf07cb53d6d9e739129d9e00778d8970
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b7b88d9ec10679504a8b4e5d24447fb95631245
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b7b88d9ec10679504a8b4e5d24447fb95631245
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4686a88b298549535f9f55ea49db6d52b3b650b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4686a88b298549535f9f55ea49db6d52b3b650b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db69de7805c39ecfc463d8b90a4dbcf83b75baa5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db69de7805c39ecfc463d8b90a4dbcf83b75baa5
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41d8ef071751c4cff5965f977b86d802a267e7d0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41d8ef071751c4cff5965f977b86d802a267e7d0
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22dbedc6498f7ae60a6608467acea3dcdca68483
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22dbedc6498f7ae60a6608467acea3dcdca68483
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2346f60646a1a51de68cb35666e660fc2f84e664
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2346f60646a1a51de68cb35666e660fc2f84e664
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee5a36e0c0f7089f42795517055602e189ce6a8e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee5a36e0c0f7089f42795517055602e189ce6a8e
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7be7e3bb816041f6efe3e40115c267da52412b99
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7be7e3bb816041f6efe3e40115c267da52412b99
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0be91c0d371878312506e329b5c0e7c2b94968cf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0be91c0d371878312506e329b5c0e7c2b94968cf
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a05c865c0b5a2ff4a709c5842e5f3c7bcda1ba67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a05c865c0b5a2ff4a709c5842e5f3c7bcda1ba67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05abcc256e4d929368ec4fcc5466d2606a70a022
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05abcc256e4d929368ec4fcc5466d2606a70a022
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0629c9b0c1ccc488ebddb40ae845c70e59a3dfb2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0629c9b0c1ccc488ebddb40ae845c70e59a3dfb2
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c05635185f5eb72b4d7da30e6a5ea188ff2ea24
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c05635185f5eb72b4d7da30e6a5ea188ff2ea24
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2323f23a2f876537fdc99d808460f15ce3a3b9cd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2323f23a2f876537fdc99d808460f15ce3a3b9cd
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69ebbfdc79fab3e7d8b983b2011e03d301933f1d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69ebbfdc79fab3e7d8b983b2011e03d301933f1d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5c12fe627c3d47d5f4bb78d504456e63d84d554
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5c12fe627c3d47d5f4bb78d504456e63d84d554
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1239af89f4a87c795ab5beacee7f5ef16febfa3b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1239af89f4a87c795ab5beacee7f5ef16febfa3b
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0100716d7fd856e8a4db0d228c10b41672a1fc67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0100716d7fd856e8a4db0d228c10b41672a1fc67
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9742b17b83abaf248ed8d2471840a49f5a2219d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9742b17b83abaf248ed8d2471840a49f5a2219d
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9a6c446a5a9efdec03dc8e4fd6afb6fa2a037e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9a6c446a5a9efdec03dc8e4fd6afb6fa2a037e4
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6e9be92fbf94d93f2fd827214db6414130105d9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6e9be92fbf94d93f2fd827214db6414130105d9
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc7facfc09bb44735177dfefed99d3aef48b2c46
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc7facfc09bb44735177dfefed99d3aef48b2c46
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aeba79dd0404e790e0ab499b0a98980f0addcbd6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aeba79dd0404e790e0ab499b0a98980f0addcbd6
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9888700db9b1968a8f0f7091b65a318aedc3d9c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9888700db9b1968a8f0f7091b65a318aedc3d9c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cecb791935a2da4dd17e1530951398e5c11d46c
11/22/2024 12:20:21 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cecb791935a2da4dd17e1530951398e5c11d46c
11/22/2024 12:20:22 PM UTC [INFO] Received an event for node: 67406d0a11fb139cb87dfa82
11/22/2024 12:22:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0a11fb139cb87dfa82
11/22/2024 12:22:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be1
11/22/2024 12:22:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be2
11/22/2024 12:22:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be3
11/22/2024 12:22:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be5
11/22/2024 12:22:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be7
11/22/2024 12:22:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0be9
11/22/2024 12:22:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0beb
11/22/2024 12:22:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bed
11/22/2024 12:22:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bef
11/22/2024 12:22:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bf1
11/22/2024 12:22:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bf3
11/22/2024 12:22:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bf5
11/22/2024 12:22:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bf7
11/22/2024 12:22:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bf8
11/22/2024 12:22:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bfb
11/22/2024 12:22:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bfc
11/22/2024 12:22:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bfe
11/22/2024 12:22:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c00
11/22/2024 12:22:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c02
11/22/2024 12:22:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c04
11/22/2024 12:22:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c07
11/22/2024 12:22:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c09
11/22/2024 12:22:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c0b
11/22/2024 12:22:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c0d
11/22/2024 12:22:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c0e
11/22/2024 12:22:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c11
11/22/2024 12:22:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c13
11/22/2024 12:22:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c15
11/22/2024 12:22:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c17
11/22/2024 12:22:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c19
11/22/2024 12:22:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c1b
11/22/2024 12:22:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c1d
11/22/2024 12:22:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c1f
11/22/2024 12:22:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c21
11/22/2024 12:22:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c23
11/22/2024 12:22:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c25
11/22/2024 12:22:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c27
11/22/2024 12:22:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c29
11/22/2024 12:22:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c2b
11/22/2024 12:22:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c2d
11/22/2024 12:22:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c2f
11/22/2024 12:22:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c30
11/22/2024 12:22:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c32
11/22/2024 12:22:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c34
11/22/2024 12:22:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c38
11/22/2024 12:22:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c3a
11/22/2024 12:22:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c3b
11/22/2024 12:22:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c3d
11/22/2024 12:22:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c3e
11/22/2024 12:22:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c3f
11/22/2024 12:22:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c40
11/22/2024 12:22:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c41
11/22/2024 12:22:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c43
11/22/2024 12:22:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c45
11/22/2024 12:22:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c48
11/22/2024 12:22:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c4a
11/22/2024 12:22:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c4c
11/22/2024 12:22:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0c4e
11/22/2024 12:22:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c50
11/22/2024 12:22:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c51
11/22/2024 12:22:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c53
11/22/2024 12:22:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c55
11/22/2024 12:22:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c57
11/22/2024 12:22:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c5c
11/22/2024 12:22:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c5d
11/22/2024 12:22:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c5f
11/22/2024 12:22:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c62
11/22/2024 12:22:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c64
11/22/2024 12:22:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c66
11/22/2024 12:22:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c67
11/22/2024 12:22:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c69
11/22/2024 12:22:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c6b
11/22/2024 12:22:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c6d
11/22/2024 12:22:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c6f
11/22/2024 12:22:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c71
11/22/2024 12:22:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c73
11/22/2024 12:22:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c76
11/22/2024 12:22:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c77
11/22/2024 12:22:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c7a
11/22/2024 12:22:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c7c
11/22/2024 12:22:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c7e
11/22/2024 12:22:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c7f
11/22/2024 12:22:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c81
11/22/2024 12:22:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c84
11/22/2024 12:22:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c86
11/22/2024 12:22:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c87
11/22/2024 12:22:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c88
11/22/2024 12:22:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c8a
11/22/2024 12:22:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c8c
11/22/2024 12:22:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c8d
11/22/2024 12:22:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c90
11/22/2024 12:22:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c91
11/22/2024 12:22:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c93
11/22/2024 12:22:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c95
11/22/2024 12:22:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c97
11/22/2024 12:22:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c98
11/22/2024 12:22:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c9a
11/22/2024 12:22:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c9b
11/22/2024 12:22:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c9c
11/22/2024 12:22:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c9e
11/22/2024 12:22:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ca0
11/22/2024 12:22:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ca2
11/22/2024 12:22:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ca4
11/22/2024 12:22:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ca6
11/22/2024 12:22:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ca8
11/22/2024 12:22:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0caa
11/22/2024 12:22:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cab
11/22/2024 12:22:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cae
11/22/2024 12:22:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cb0
11/22/2024 12:22:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cb2
11/22/2024 12:22:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cb4
11/22/2024 12:22:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cb6
11/22/2024 12:22:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cb8
11/22/2024 12:22:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cbb
11/22/2024 12:22:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cbd
11/22/2024 12:22:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cbe
11/22/2024 12:22:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cc1
11/22/2024 12:22:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cc3
11/22/2024 12:22:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cc5
11/22/2024 12:22:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cc7
11/22/2024 12:22:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cca
11/22/2024 12:22:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ccc
11/22/2024 12:22:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ccd
11/22/2024 12:22:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cce
11/22/2024 12:22:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cd0
11/22/2024 12:22:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cd1
11/22/2024 12:22:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cd2
11/22/2024 12:22:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cd6
11/22/2024 12:22:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cd8
11/22/2024 12:22:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cda
11/22/2024 12:22:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cdc
11/22/2024 12:22:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cdd
11/22/2024 12:22:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cdf
11/22/2024 12:23:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ce2
11/22/2024 12:23:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ce4
11/22/2024 12:23:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cea
11/22/2024 12:23:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0ced
11/22/2024 12:23:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cee
11/22/2024 12:23:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cf1
11/22/2024 12:23:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cf3
11/22/2024 12:23:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cf5
11/22/2024 12:23:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cf6
11/22/2024 12:23:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cf8
11/22/2024 12:23:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cfa
11/22/2024 12:23:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cfc
11/22/2024 12:23:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0cfe
11/22/2024 12:23:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d00
11/22/2024 12:23:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d02
11/22/2024 12:23:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d04
11/22/2024 12:23:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d06
11/22/2024 12:23:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d08
11/22/2024 12:23:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d0a
11/22/2024 12:23:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d0b
11/22/2024 12:23:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d0c
11/22/2024 12:23:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d0e
11/22/2024 12:23:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d10
11/22/2024 12:23:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d12
11/22/2024 12:23:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d14
11/22/2024 12:23:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d15
11/22/2024 12:23:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d16
11/22/2024 12:23:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d17
11/22/2024 12:23:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d19
11/22/2024 12:23:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d1b
11/22/2024 12:23:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d1d
11/22/2024 12:23:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d1e
11/22/2024 12:23:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d21
11/22/2024 12:23:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d23
11/22/2024 12:23:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d25
11/22/2024 12:23:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d27
11/22/2024 12:23:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d2a
11/22/2024 12:23:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d2c
11/22/2024 12:23:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d2d
11/22/2024 12:23:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d2e
11/22/2024 12:23:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d2f
11/22/2024 12:23:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d30
11/22/2024 12:23:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d31
11/22/2024 12:23:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d33
11/22/2024 12:23:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d35
11/22/2024 12:23:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d37
11/22/2024 12:23:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d39
11/22/2024 12:23:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d3a
11/22/2024 12:23:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d3c
11/22/2024 12:23:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d3e
11/22/2024 12:23:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d40
11/22/2024 12:23:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d41
11/22/2024 12:23:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d42
11/22/2024 12:23:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d43
11/22/2024 12:23:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d44
11/22/2024 12:23:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d47
11/22/2024 12:23:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d4a
11/22/2024 12:23:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d4c
11/22/2024 12:23:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d4e
11/22/2024 12:23:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d50
11/22/2024 12:23:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d52
11/22/2024 12:23:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d54
11/22/2024 12:23:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d56
11/22/2024 12:23:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d58
11/22/2024 12:23:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d5a
11/22/2024 12:23:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d5c
11/22/2024 12:23:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d5e
11/22/2024 12:23:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d60
11/22/2024 12:23:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d62
11/22/2024 12:23:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d64
11/22/2024 12:23:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d66
11/22/2024 12:23:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d68
11/22/2024 12:23:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d6a
11/22/2024 12:23:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d6c
11/22/2024 12:23:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d6e
11/22/2024 12:23:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d70
11/22/2024 12:23:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d72
11/22/2024 12:23:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d74
11/22/2024 12:23:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d76
11/22/2024 12:23:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d78
11/22/2024 12:23:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d7a
11/22/2024 12:23:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d7c
11/22/2024 12:23:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d7e
11/22/2024 12:23:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d80
11/22/2024 12:23:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d81
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0a11fb139cb87dfa82
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd0
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd4
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd6
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bd8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bda
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bdc
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bdd
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bde
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be1
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be3
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be5
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be7
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0be9
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0beb
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bed
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bef
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf1
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf3
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf5
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf7
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bf8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bfb
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bfc
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bfe
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c00
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c02
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c04
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c07
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c09
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c0e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c11
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c13
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c15
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c17
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c19
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c1f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c21
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c23
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c25
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c27
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c29
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c2f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c30
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c32
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c34
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c38
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c3f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c40
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c41
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c43
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c45
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c48
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c4a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c4c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0c4e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c50
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c51
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c53
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c55
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c57
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c5c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c5d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c5f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c62
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c64
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c66
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c67
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c69
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c6f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c71
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c73
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c76
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c77
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c7f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c81
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c84
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c86
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c87
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c88
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c8d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c90
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c91
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c93
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c95
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c97
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c98
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c9e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca0
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca4
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca6
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ca8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0caa
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cab
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cae
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb0
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb4
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb6
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cb8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cbb
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cbd
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cbe
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc1
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc3
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc5
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cc7
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cca
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ccc
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ccd
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cce
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd0
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd1
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd6
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cd8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cda
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cdc
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cdd
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cdf
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce2
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ce4
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cea
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0ced
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cee
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf1
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf3
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf5
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf6
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cf8
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cfa
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cfc
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0cfe
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d00
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d02
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d04
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d06
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d08
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d0e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d10
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d12
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d14
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d15
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d16
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d17
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d19
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1b
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d1e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d21
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d23
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d25
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d27
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2d
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d2f
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d30
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d31
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d33
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d35
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d37
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d39
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d3e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d40
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d41
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d42
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d43
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d44
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d47
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d4e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d50
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d52
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d54
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d56
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d58
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d5e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d60
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d62
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d64
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d66
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d68
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d6e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d70
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d72
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d74
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d76
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d78
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7a
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7c
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d7e
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d80
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d81
11/22/2024 12:23:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d8f
11/22/2024 12:23:26 PM UTC [INFO] Received an event for node: 67406d0011fb139cb87dfa3d
11/22/2024 12:24:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0011fb139cb87dfa3d
11/22/2024 12:24:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de4
11/22/2024 12:24:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de6
11/22/2024 12:24:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0011fb139cb87dfa3d
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9b
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9c
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9d
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9e
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9f
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0da9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0daa
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dab
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dac
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dad
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dae
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0daf
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0db9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dba
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dbb
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dbc
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dbd
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dbe
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dbf
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dc9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dca
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dcb
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dcc
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dcd
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dce
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dcf
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dd9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dda
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0ddb
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0ddc
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0ddd
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dde
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0ddf
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dea
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0deb
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dec
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0ded
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dee
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0def
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df0
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df1
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df2
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df3
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df4
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df5
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df6
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df7
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df8
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0df9
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dfa
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dfb
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dfc
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dfd
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dfe
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0dff
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e00
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e01
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e02
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e03
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e04
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e05
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e06
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e07
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e08
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e09
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0a
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0b
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0c
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0d
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0e
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e0f
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e10
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e11
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e12
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e13
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e14
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e15
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e16
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e17
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e18
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e19
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e1a
11/22/2024 12:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e1b
11/22/2024 12:24:28 PM UTC [INFO] Received an event for node: 67406d1011fb139cb87dfab1
11/22/2024 12:26:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1011fb139cb87dfab1
11/22/2024 12:26:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e30
11/22/2024 12:26:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e31
11/22/2024 12:26:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e32
11/22/2024 12:26:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e33
11/22/2024 12:26:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e34
11/22/2024 12:26:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e35
11/22/2024 12:26:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e36
11/22/2024 12:26:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e37
11/22/2024 12:26:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e38
11/22/2024 12:26:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e39
11/22/2024 12:26:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3a
11/22/2024 12:26:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3b
11/22/2024 12:26:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3c
11/22/2024 12:26:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3d
11/22/2024 12:26:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3e
11/22/2024 12:26:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e3f
11/22/2024 12:26:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e40
11/22/2024 12:26:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e41
11/22/2024 12:26:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e42
11/22/2024 12:26:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e43
11/22/2024 12:26:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e44
11/22/2024 12:26:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e45
11/22/2024 12:26:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e46
11/22/2024 12:26:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e47
11/22/2024 12:26:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e48
11/22/2024 12:26:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e49
11/22/2024 12:26:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4a
11/22/2024 12:26:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4b
11/22/2024 12:26:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4c
11/22/2024 12:26:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4d
11/22/2024 12:26:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4e
11/22/2024 12:26:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e4f
11/22/2024 12:26:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e50
11/22/2024 12:26:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e51
11/22/2024 12:26:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e52
11/22/2024 12:26:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e53
11/22/2024 12:26:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e54
11/22/2024 12:26:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e55
11/22/2024 12:26:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e56
11/22/2024 12:26:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e57
11/22/2024 12:26:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e58
11/22/2024 12:26:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e59
11/22/2024 12:26:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5a
11/22/2024 12:26:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5b
11/22/2024 12:26:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5c
11/22/2024 12:26:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5d
11/22/2024 12:26:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5e
11/22/2024 12:26:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e5f
11/22/2024 12:26:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e60
11/22/2024 12:26:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e61
11/22/2024 12:26:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e62
11/22/2024 12:26:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e63
11/22/2024 12:26:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e64
11/22/2024 12:26:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e65
11/22/2024 12:26:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e66
11/22/2024 12:26:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e67
11/22/2024 12:26:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e68
11/22/2024 12:26:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e69
11/22/2024 12:26:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6a
11/22/2024 12:26:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6b
11/22/2024 12:26:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6c
11/22/2024 12:26:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6d
11/22/2024 12:26:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6e
11/22/2024 12:26:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e6f
11/22/2024 12:26:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e70
11/22/2024 12:26:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e71
11/22/2024 12:26:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e72
11/22/2024 12:26:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e73
11/22/2024 12:26:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e75
11/22/2024 12:26:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e76
11/22/2024 12:26:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e77
11/22/2024 12:26:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e78
11/22/2024 12:26:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e79
11/22/2024 12:26:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7a
11/22/2024 12:26:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7b
11/22/2024 12:26:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7c
11/22/2024 12:26:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7d
11/22/2024 12:26:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7e
11/22/2024 12:26:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e7f
11/22/2024 12:26:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e80
11/22/2024 12:26:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e81
11/22/2024 12:26:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e82
11/22/2024 12:26:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e83
11/22/2024 12:26:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e84
11/22/2024 12:26:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e85
11/22/2024 12:26:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e86
11/22/2024 12:26:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e87
11/22/2024 12:26:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e88
11/22/2024 12:26:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e89
11/22/2024 12:26:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8a
11/22/2024 12:26:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8b
11/22/2024 12:26:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8c
11/22/2024 12:26:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8d
11/22/2024 12:26:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8e
11/22/2024 12:26:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e90
11/22/2024 12:26:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e92
11/22/2024 12:26:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e93
11/22/2024 12:26:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e94
11/22/2024 12:26:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e95
11/22/2024 12:26:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e96
11/22/2024 12:26:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e97
11/22/2024 12:26:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e98
11/22/2024 12:26:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e99
11/22/2024 12:26:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9a
11/22/2024 12:26:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9b
11/22/2024 12:26:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9c
11/22/2024 12:26:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9d
11/22/2024 12:26:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9e
11/22/2024 12:26:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e9f
11/22/2024 12:27:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0ea0
11/22/2024 12:27:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0ea1
11/22/2024 12:27:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0ea2
11/22/2024 12:27:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0ea3
11/22/2024 12:27:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0ea4
11/22/2024 12:27:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ea5
11/22/2024 12:27:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ea6
11/22/2024 12:27:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ea7
11/22/2024 12:27:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ea8
11/22/2024 12:27:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ea9
11/22/2024 12:27:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eaa
11/22/2024 12:27:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eab
11/22/2024 12:27:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eac
11/22/2024 12:27:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ead
11/22/2024 12:27:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eae
11/22/2024 12:27:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eaf
11/22/2024 12:27:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb0
11/22/2024 12:27:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb1
11/22/2024 12:27:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb2
11/22/2024 12:27:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb3
11/22/2024 12:27:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb4
11/22/2024 12:27:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb5
11/22/2024 12:27:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb6
11/22/2024 12:27:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb7
11/22/2024 12:27:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb8
11/22/2024 12:27:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eb9
11/22/2024 12:27:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eba
11/22/2024 12:27:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ebb
11/22/2024 12:27:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ebc
11/22/2024 12:27:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ebd
11/22/2024 12:27:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ebe
11/22/2024 12:27:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ebf
11/22/2024 12:27:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec0
11/22/2024 12:27:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec1
11/22/2024 12:27:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec2
11/22/2024 12:27:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec3
11/22/2024 12:27:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec4
11/22/2024 12:27:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec5
11/22/2024 12:27:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec6
11/22/2024 12:27:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec7
11/22/2024 12:27:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec8
11/22/2024 12:27:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ec9
11/22/2024 12:27:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eca
11/22/2024 12:27:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ecb
11/22/2024 12:27:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ecc
11/22/2024 12:27:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ecd
11/22/2024 12:27:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ece
11/22/2024 12:27:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ecf
11/22/2024 12:27:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed0
11/22/2024 12:27:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed1
11/22/2024 12:27:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed2
11/22/2024 12:27:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed3
11/22/2024 12:27:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed4
11/22/2024 12:27:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed5
11/22/2024 12:27:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed6
11/22/2024 12:27:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed7
11/22/2024 12:27:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed8
11/22/2024 12:27:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ed9
11/22/2024 12:27:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eda
11/22/2024 12:27:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0edb
11/22/2024 12:27:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0edc
11/22/2024 12:27:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0edd
11/22/2024 12:27:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ede
11/22/2024 12:27:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0edf
11/22/2024 12:27:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee0
11/22/2024 12:27:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee1
11/22/2024 12:27:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee2
11/22/2024 12:27:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee3
11/22/2024 12:27:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee4
11/22/2024 12:27:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee5
11/22/2024 12:27:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee6
11/22/2024 12:27:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee7
11/22/2024 12:27:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee8
11/22/2024 12:27:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ee9
11/22/2024 12:27:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eea
11/22/2024 12:27:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eeb
11/22/2024 12:27:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eec
11/22/2024 12:27:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eed
11/22/2024 12:27:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eee
11/22/2024 12:27:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eef
11/22/2024 12:27:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef0
11/22/2024 12:27:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef1
11/22/2024 12:27:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef2
11/22/2024 12:27:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef3
11/22/2024 12:27:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef4
11/22/2024 12:27:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef5
11/22/2024 12:27:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef6
11/22/2024 12:27:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef7
11/22/2024 12:27:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef8
11/22/2024 12:27:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0ef9
11/22/2024 12:27:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0efa
11/22/2024 12:27:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0efb
11/22/2024 12:27:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0efc
11/22/2024 12:27:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0efd
11/22/2024 12:27:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0efe
11/22/2024 12:27:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0eff
11/22/2024 12:27:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f00
11/22/2024 12:27:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f01
11/22/2024 12:27:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f02
11/22/2024 12:27:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f03
11/22/2024 12:27:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f04
11/22/2024 12:27:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f05
11/22/2024 12:27:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f06
11/22/2024 12:27:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f07
11/22/2024 12:27:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f08
11/22/2024 12:27:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f09
11/22/2024 12:27:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f0a
11/22/2024 12:27:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f0b
11/22/2024 12:27:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f0c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1011fb139cb87dfab1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e27
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e28
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e29
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e2f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e30
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e31
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e32
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e33
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e34
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e35
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e36
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e37
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e38
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e39
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e3f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e40
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e41
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e42
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e43
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e44
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e45
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e46
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e47
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e48
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e49
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e4f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e50
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e51
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e52
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e53
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e54
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e55
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e56
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e57
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e58
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e59
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e5f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e60
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e61
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e62
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e63
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e64
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e65
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e66
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e67
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e68
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e69
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e6f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e70
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e71
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e72
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e73
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e75
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e76
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e77
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e78
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e79
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e7f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e80
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e81
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e82
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e83
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e84
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e85
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e86
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e87
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e88
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e89
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e90
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e92
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e93
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e94
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e95
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e96
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e97
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e98
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e99
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9d
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9e
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e9f
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0ea0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0ea1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0ea2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0ea3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0ea4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ea5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ea6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ea7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ea8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ea9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eaa
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eab
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eac
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ead
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eae
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eaf
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eb9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eba
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ebb
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ebc
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ebd
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ebe
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ebf
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ec9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eca
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ecb
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ecc
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ecd
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ece
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ecf
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ed9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eda
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0edb
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0edc
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0edd
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ede
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0edf
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ee9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eea
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eeb
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eec
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eed
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eee
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eef
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef0
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef1
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef2
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef3
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef4
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef5
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef6
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef7
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef8
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0ef9
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0efa
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0efb
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0efc
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0efd
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0efe
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0eff
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f00
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f01
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f02
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f03
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f04
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f05
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f06
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f07
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f08
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f09
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f0a
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f0b
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f0c
11/22/2024 12:27:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f0d
11/22/2024 12:27:35 PM UTC [INFO] Received an event for node: 674068e311fb139cb87df673
11/22/2024 12:27:35 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e311fb139cb87df673
11/22/2024 12:27:35 PM UTC [INFO] Received an event for node: 67406d0511fb139cb87dfa5e
11/22/2024 12:28:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0511fb139cb87dfa5e
11/22/2024 12:28:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f67
11/22/2024 12:28:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f69
11/22/2024 12:28:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f6a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0511fb139cb87dfa5e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f1e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f1f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f20
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f21
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f22
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f23
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f24
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f25
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f26
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f27
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f28
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f29
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f2f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f30
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f31
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f32
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f33
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f34
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f35
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f36
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f37
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f38
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f39
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f3f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f40
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f41
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f42
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f43
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f44
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f45
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f46
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f47
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f48
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f49
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f4f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f50
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f51
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f52
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f53
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f54
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f55
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f56
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f57
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f58
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f59
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f5f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f60
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f61
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f62
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f63
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f64
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f65
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f66
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f67
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f68
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f69
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f70
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f71
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f72
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f73
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f74
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f75
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f76
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f77
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f78
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f79
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f7f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f80
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f81
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f82
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f83
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f84
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f85
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f86
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f87
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f88
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f89
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8e
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f8f
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f90
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f91
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f92
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f93
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f94
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f95
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f96
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f97
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f98
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f99
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f9a
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f9b
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f9c
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f9d
11/22/2024 12:28:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f9e
11/22/2024 12:28:43 PM UTC [INFO] Received an event for node: 67406cf911fb139cb87dfa08
11/22/2024 12:28:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf911fb139cb87dfa08
11/22/2024 12:28:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0fa7
11/22/2024 12:28:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0fa8
11/22/2024 12:28:47 PM UTC [INFO] Received an event for node: 67406d0d11fb139cb87dfa97
11/22/2024 12:30:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0d11fb139cb87dfa97
11/22/2024 12:30:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fd9
11/22/2024 12:30:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fda
11/22/2024 12:30:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fdb
11/22/2024 12:30:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fdc
11/22/2024 12:30:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fdd
11/22/2024 12:30:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fde
11/22/2024 12:30:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fdf
11/22/2024 12:30:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe0
11/22/2024 12:30:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe1
11/22/2024 12:30:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe2
11/22/2024 12:30:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe3
11/22/2024 12:30:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe4
11/22/2024 12:30:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe5
11/22/2024 12:30:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe6
11/22/2024 12:30:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe7
11/22/2024 12:30:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe8
11/22/2024 12:30:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fe9
11/22/2024 12:30:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fea
11/22/2024 12:30:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0feb
11/22/2024 12:30:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fec
11/22/2024 12:30:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fed
11/22/2024 12:30:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fee
11/22/2024 12:30:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fef
11/22/2024 12:30:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff0
11/22/2024 12:30:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff1
11/22/2024 12:30:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff2
11/22/2024 12:30:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff3
11/22/2024 12:30:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff4
11/22/2024 12:30:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff5
11/22/2024 12:30:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff6
11/22/2024 12:30:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff7
11/22/2024 12:30:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff8
11/22/2024 12:30:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ff9
11/22/2024 12:30:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ffa
11/22/2024 12:30:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ffb
11/22/2024 12:30:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ffc
11/22/2024 12:30:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ffd
11/22/2024 12:30:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0ffe
11/22/2024 12:30:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e0fff
11/22/2024 12:30:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1000
11/22/2024 12:30:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1001
11/22/2024 12:30:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1002
11/22/2024 12:30:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1003
11/22/2024 12:30:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1004
11/22/2024 12:30:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1005
11/22/2024 12:30:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1006
11/22/2024 12:30:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1007
11/22/2024 12:30:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1008
11/22/2024 12:30:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1009
11/22/2024 12:30:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100a
11/22/2024 12:30:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100b
11/22/2024 12:30:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100c
11/22/2024 12:30:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100d
11/22/2024 12:30:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100e
11/22/2024 12:30:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e100f
11/22/2024 12:30:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1010
11/22/2024 12:30:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1011
11/22/2024 12:30:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1012
11/22/2024 12:30:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1013
11/22/2024 12:30:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1014
11/22/2024 12:30:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1015
11/22/2024 12:30:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1016
11/22/2024 12:31:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1017
11/22/2024 12:31:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1018
11/22/2024 12:31:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1019
11/22/2024 12:31:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101a
11/22/2024 12:31:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101b
11/22/2024 12:31:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101c
11/22/2024 12:31:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101d
11/22/2024 12:31:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101e
11/22/2024 12:31:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e101f
11/22/2024 12:31:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1020
11/22/2024 12:31:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1021
11/22/2024 12:31:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1022
11/22/2024 12:31:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1023
11/22/2024 12:31:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1024
11/22/2024 12:31:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1025
11/22/2024 12:31:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1026
11/22/2024 12:31:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1027
11/22/2024 12:31:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1028
11/22/2024 12:31:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1029
11/22/2024 12:31:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102a
11/22/2024 12:31:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102b
11/22/2024 12:31:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102c
11/22/2024 12:31:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102d
11/22/2024 12:31:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102e
11/22/2024 12:31:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e102f
11/22/2024 12:31:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1030
11/22/2024 12:31:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1031
11/22/2024 12:31:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1032
11/22/2024 12:31:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1033
11/22/2024 12:31:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1034
11/22/2024 12:31:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1035
11/22/2024 12:31:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1036
11/22/2024 12:31:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1037
11/22/2024 12:31:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1038
11/22/2024 12:31:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1039
11/22/2024 12:31:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103a
11/22/2024 12:31:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103b
11/22/2024 12:31:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103c
11/22/2024 12:31:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103d
11/22/2024 12:31:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103e
11/22/2024 12:31:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e103f
11/22/2024 12:31:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1040
11/22/2024 12:31:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1041
11/22/2024 12:31:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1042
11/22/2024 12:31:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1043
11/22/2024 12:31:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1044
11/22/2024 12:31:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1045
11/22/2024 12:31:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1046
11/22/2024 12:31:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1047
11/22/2024 12:31:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1048
11/22/2024 12:31:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1049
11/22/2024 12:31:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104a
11/22/2024 12:31:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104b
11/22/2024 12:31:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104c
11/22/2024 12:31:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104d
11/22/2024 12:31:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104e
11/22/2024 12:31:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e104f
11/22/2024 12:31:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1050
11/22/2024 12:31:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1051
11/22/2024 12:31:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1052
11/22/2024 12:31:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1053
11/22/2024 12:31:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1054
11/22/2024 12:31:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1055
11/22/2024 12:31:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1056
11/22/2024 12:31:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1057
11/22/2024 12:31:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1058
11/22/2024 12:31:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1059
11/22/2024 12:31:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105a
11/22/2024 12:31:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105b
11/22/2024 12:31:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105c
11/22/2024 12:31:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105d
11/22/2024 12:31:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105e
11/22/2024 12:31:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e105f
11/22/2024 12:31:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1060
11/22/2024 12:31:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1061
11/22/2024 12:31:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1062
11/22/2024 12:31:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1063
11/22/2024 12:31:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1064
11/22/2024 12:31:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1065
11/22/2024 12:31:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1066
11/22/2024 12:31:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1067
11/22/2024 12:31:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1068
11/22/2024 12:31:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1069
11/22/2024 12:31:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106a
11/22/2024 12:31:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106b
11/22/2024 12:31:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106c
11/22/2024 12:31:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106d
11/22/2024 12:31:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106e
11/22/2024 12:31:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e106f
11/22/2024 12:31:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1070
11/22/2024 12:31:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1071
11/22/2024 12:31:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1072
11/22/2024 12:31:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1073
11/22/2024 12:31:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1074
11/22/2024 12:31:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1075
11/22/2024 12:31:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1076
11/22/2024 12:31:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1077
11/22/2024 12:31:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1078
11/22/2024 12:31:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1079
11/22/2024 12:31:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107a
11/22/2024 12:31:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107b
11/22/2024 12:31:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107c
11/22/2024 12:31:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107d
11/22/2024 12:31:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107e
11/22/2024 12:31:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e107f
11/22/2024 12:31:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1080
11/22/2024 12:31:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1081
11/22/2024 12:31:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1082
11/22/2024 12:31:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1083
11/22/2024 12:31:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1084
11/22/2024 12:31:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1085
11/22/2024 12:31:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1086
11/22/2024 12:31:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1087
11/22/2024 12:31:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1088
11/22/2024 12:31:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1089
11/22/2024 12:31:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108a
11/22/2024 12:31:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108b
11/22/2024 12:31:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108c
11/22/2024 12:31:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108d
11/22/2024 12:31:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108e
11/22/2024 12:31:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e108f
11/22/2024 12:31:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1090
11/22/2024 12:31:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1091
11/22/2024 12:31:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1092
11/22/2024 12:31:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1093
11/22/2024 12:31:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1094
11/22/2024 12:31:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1095
11/22/2024 12:31:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1096
11/22/2024 12:31:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1097
11/22/2024 12:31:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1098
11/22/2024 12:31:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e1099
11/22/2024 12:31:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109a
11/22/2024 12:31:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109b
11/22/2024 12:31:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109c
11/22/2024 12:31:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109d
11/22/2024 12:31:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109e
11/22/2024 12:31:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e109f
11/22/2024 12:31:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a0
11/22/2024 12:31:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a1
11/22/2024 12:31:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a2
11/22/2024 12:31:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a3
11/22/2024 12:31:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a4
11/22/2024 12:31:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a5
11/22/2024 12:31:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a6
11/22/2024 12:31:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a7
11/22/2024 12:31:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a8
11/22/2024 12:31:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10a9
11/22/2024 12:31:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10aa
11/22/2024 12:31:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10ab
11/22/2024 12:31:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10ac
11/22/2024 12:31:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10ad
11/22/2024 12:31:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10ae
11/22/2024 12:31:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10af
11/22/2024 12:31:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10b0
11/22/2024 12:31:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10b1
11/22/2024 12:31:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8c11fb139cb87e10b2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0d11fb139cb87dfa97
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd0
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd1
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd3
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd4
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd5
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd6
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd7
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd8
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fd9
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fda
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fdb
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fdc
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fdd
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fde
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fdf
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe0
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe1
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe3
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe4
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe5
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe6
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe7
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe8
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fe9
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fea
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0feb
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fec
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fed
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fee
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fef
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff0
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff1
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff3
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff4
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff5
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff6
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff7
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff8
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ff9
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ffa
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ffb
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ffc
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ffd
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0ffe
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e0fff
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1000
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1001
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1002
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1003
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1004
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1005
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1006
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1007
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1008
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1009
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e100f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1010
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1011
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1012
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1013
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1014
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1015
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1016
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1017
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1018
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1019
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e101f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1020
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1021
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1022
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1023
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1024
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1025
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1026
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1027
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1028
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1029
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e102f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1030
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1031
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1032
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1033
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1034
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1035
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1036
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1037
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1038
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1039
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e103f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1040
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1041
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1042
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1043
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1044
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1045
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1046
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1047
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1048
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1049
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e104f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1050
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1051
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1052
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1053
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1054
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1055
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1056
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1057
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1058
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1059
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e105f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1060
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1061
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1062
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1063
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1064
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1065
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1066
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1067
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1068
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1069
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e106f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1070
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1071
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1072
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1073
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1074
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1075
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1076
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1077
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1078
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1079
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e107f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1080
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1081
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1082
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1083
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1084
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1085
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1086
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1087
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1088
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1089
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e108f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1090
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1091
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1092
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1093
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1094
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1095
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1096
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1097
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1098
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e1099
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109a
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109b
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109c
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109d
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109e
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e109f
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a0
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a1
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a3
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a4
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a5
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a6
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a7
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a8
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10a9
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10aa
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10ab
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10ac
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10ad
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10ae
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10af
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10b0
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10b1
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10b2
11/22/2024 12:31:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8c11fb139cb87e10b3
11/22/2024 12:31:48 PM UTC [INFO] Received an event for node: 67406cf811fb139cb87dfa02
11/22/2024 12:31:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf811fb139cb87dfa02
11/22/2024 12:31:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9911fb139cb87e10b9
11/22/2024 12:31:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9911fb139cb87e10ba
11/22/2024 12:31:50 PM UTC [INFO] Received an event for node: 67406d1211fb139cb87dfac0
11/22/2024 12:31:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1211fb139cb87dfac0
11/22/2024 12:31:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9911fb139cb87e10c0
11/22/2024 12:31:52 PM UTC [INFO] Received an event for node: 67406d1311fb139cb87dfac3
11/22/2024 12:31:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1311fb139cb87dfac3
11/22/2024 12:31:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e112b
11/22/2024 12:31:54 PM UTC [INFO] Received an event for node: 67406d0f11fb139cb87dfaa0
11/22/2024 12:34:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0f11fb139cb87dfaa0
11/22/2024 12:34:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10cf
11/22/2024 12:34:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d0
11/22/2024 12:34:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d1
11/22/2024 12:34:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d2
11/22/2024 12:34:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d3
11/22/2024 12:34:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d4
11/22/2024 12:34:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d5
11/22/2024 12:34:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d6
11/22/2024 12:34:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d7
11/22/2024 12:34:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d8
11/22/2024 12:34:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10d9
11/22/2024 12:34:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10da
11/22/2024 12:34:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10db
11/22/2024 12:34:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10dc
11/22/2024 12:34:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10dd
11/22/2024 12:34:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10de
11/22/2024 12:34:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10df
11/22/2024 12:34:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e0
11/22/2024 12:34:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e1
11/22/2024 12:34:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e2
11/22/2024 12:34:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e3
11/22/2024 12:34:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e4
11/22/2024 12:34:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e5
11/22/2024 12:34:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e6
11/22/2024 12:34:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e7
11/22/2024 12:34:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e8
11/22/2024 12:34:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10e9
11/22/2024 12:34:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ea
11/22/2024 12:34:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10eb
11/22/2024 12:34:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ec
11/22/2024 12:34:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ed
11/22/2024 12:34:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ee
11/22/2024 12:34:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ef
11/22/2024 12:34:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f0
11/22/2024 12:34:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f1
11/22/2024 12:34:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f2
11/22/2024 12:34:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f3
11/22/2024 12:34:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f4
11/22/2024 12:34:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f5
11/22/2024 12:34:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f6
11/22/2024 12:34:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f7
11/22/2024 12:34:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f8
11/22/2024 12:34:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10f9
11/22/2024 12:34:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10fa
11/22/2024 12:34:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10fb
11/22/2024 12:34:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10fc
11/22/2024 12:34:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10fd
11/22/2024 12:34:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10fe
11/22/2024 12:34:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e10ff
11/22/2024 12:34:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1100
11/22/2024 12:34:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1101
11/22/2024 12:34:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1102
11/22/2024 12:34:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1103
11/22/2024 12:34:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1104
11/22/2024 12:34:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1105
11/22/2024 12:34:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1106
11/22/2024 12:34:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1107
11/22/2024 12:34:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1108
11/22/2024 12:34:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1109
11/22/2024 12:34:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110a
11/22/2024 12:34:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110b
11/22/2024 12:34:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110c
11/22/2024 12:34:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110d
11/22/2024 12:34:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110e
11/22/2024 12:34:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e110f
11/22/2024 12:34:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1110
11/22/2024 12:34:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1111
11/22/2024 12:34:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1112
11/22/2024 12:34:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1113
11/22/2024 12:34:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1114
11/22/2024 12:34:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1115
11/22/2024 12:34:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1116
11/22/2024 12:34:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1117
11/22/2024 12:34:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1118
11/22/2024 12:34:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1119
11/22/2024 12:34:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111a
11/22/2024 12:34:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111b
11/22/2024 12:34:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111c
11/22/2024 12:34:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111d
11/22/2024 12:34:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111e
11/22/2024 12:34:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e111f
11/22/2024 12:34:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1120
11/22/2024 12:34:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1121
11/22/2024 12:34:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1122
11/22/2024 12:34:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1123
11/22/2024 12:34:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1124
11/22/2024 12:34:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1125
11/22/2024 12:34:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1126
11/22/2024 12:34:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1127
11/22/2024 12:34:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1128
11/22/2024 12:34:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e112a
11/22/2024 12:34:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e112c
11/22/2024 12:34:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e112e
11/22/2024 12:34:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1130
11/22/2024 12:34:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1133
11/22/2024 12:34:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1134
11/22/2024 12:34:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1135
11/22/2024 12:34:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1136
11/22/2024 12:34:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1137
11/22/2024 12:34:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1138
11/22/2024 12:34:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1139
11/22/2024 12:34:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113a
11/22/2024 12:34:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113b
11/22/2024 12:34:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113c
11/22/2024 12:34:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113d
11/22/2024 12:34:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113e
11/22/2024 12:34:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e113f
11/22/2024 12:34:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1140
11/22/2024 12:34:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1141
11/22/2024 12:34:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1142
11/22/2024 12:34:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1143
11/22/2024 12:34:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1144
11/22/2024 12:34:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1145
11/22/2024 12:34:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1146
11/22/2024 12:34:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1147
11/22/2024 12:34:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1148
11/22/2024 12:34:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1149
11/22/2024 12:34:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114a
11/22/2024 12:34:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114b
11/22/2024 12:34:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114c
11/22/2024 12:34:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114d
11/22/2024 12:34:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114e
11/22/2024 12:34:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e114f
11/22/2024 12:34:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1150
11/22/2024 12:34:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1151
11/22/2024 12:34:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1152
11/22/2024 12:34:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1153
11/22/2024 12:34:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1154
11/22/2024 12:34:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1155
11/22/2024 12:34:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1156
11/22/2024 12:34:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1157
11/22/2024 12:34:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1158
11/22/2024 12:34:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1159
11/22/2024 12:34:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115a
11/22/2024 12:34:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115b
11/22/2024 12:34:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115c
11/22/2024 12:34:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115d
11/22/2024 12:34:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115e
11/22/2024 12:35:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e115f
11/22/2024 12:35:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1160
11/22/2024 12:35:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1161
11/22/2024 12:35:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1162
11/22/2024 12:35:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1163
11/22/2024 12:35:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1164
11/22/2024 12:35:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1165
11/22/2024 12:35:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1166
11/22/2024 12:35:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1167
11/22/2024 12:35:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1168
11/22/2024 12:35:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1169
11/22/2024 12:35:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116a
11/22/2024 12:35:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116b
11/22/2024 12:35:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116c
11/22/2024 12:35:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116d
11/22/2024 12:35:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116e
11/22/2024 12:35:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e116f
11/22/2024 12:35:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1170
11/22/2024 12:35:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1171
11/22/2024 12:35:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1172
11/22/2024 12:35:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1173
11/22/2024 12:35:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1174
11/22/2024 12:35:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1175
11/22/2024 12:35:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1176
11/22/2024 12:35:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1177
11/22/2024 12:35:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1178
11/22/2024 12:35:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1179
11/22/2024 12:35:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117a
11/22/2024 12:35:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117b
11/22/2024 12:35:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117c
11/22/2024 12:35:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117d
11/22/2024 12:35:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117e
11/22/2024 12:35:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e117f
11/22/2024 12:35:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1180
11/22/2024 12:35:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1181
11/22/2024 12:35:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1182
11/22/2024 12:35:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1183
11/22/2024 12:35:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1184
11/22/2024 12:35:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1185
11/22/2024 12:35:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1186
11/22/2024 12:35:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1187
11/22/2024 12:35:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1188
11/22/2024 12:35:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1189
11/22/2024 12:35:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118a
11/22/2024 12:35:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118b
11/22/2024 12:35:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118c
11/22/2024 12:35:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118d
11/22/2024 12:35:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118e
11/22/2024 12:35:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e118f
11/22/2024 12:35:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1190
11/22/2024 12:35:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1191
11/22/2024 12:35:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1192
11/22/2024 12:35:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1193
11/22/2024 12:35:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1194
11/22/2024 12:35:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1195
11/22/2024 12:35:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1196
11/22/2024 12:35:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1197
11/22/2024 12:35:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1198
11/22/2024 12:35:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e1199
11/22/2024 12:35:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119a
11/22/2024 12:35:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119b
11/22/2024 12:35:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119c
11/22/2024 12:35:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119d
11/22/2024 12:35:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119e
11/22/2024 12:35:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e119f
11/22/2024 12:35:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a0
11/22/2024 12:35:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a1
11/22/2024 12:35:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a2
11/22/2024 12:35:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a3
11/22/2024 12:35:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a4
11/22/2024 12:35:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a5
11/22/2024 12:35:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a6
11/22/2024 12:35:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a7
11/22/2024 12:35:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a8
11/22/2024 12:35:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11a9
11/22/2024 12:35:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11aa
11/22/2024 12:35:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11ab
11/22/2024 12:35:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11ac
11/22/2024 12:35:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11ad
11/22/2024 12:35:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9a11fb139cb87e11ae
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaa0
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10c6
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10c7
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10c8
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10c9
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ca
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10cb
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10cc
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10cd
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ce
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10cf
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d0
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d1
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d2
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d3
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d4
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d5
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d6
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d7
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d8
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10d9
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10da
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10db
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10dc
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10dd
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10de
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10df
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e0
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e1
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e2
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e3
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e4
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e5
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e6
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e7
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e8
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10e9
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ea
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10eb
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ec
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ed
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ee
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ef
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f0
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f1
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f2
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f3
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f4
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f5
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f6
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f7
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f8
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10f9
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10fa
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10fb
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10fc
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10fd
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10fe
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e10ff
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1100
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1101
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1102
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1103
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1104
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1105
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1106
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1107
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1108
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1109
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e110f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1110
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1111
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1112
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1113
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1114
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1115
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1116
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1117
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1118
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1119
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e111f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1120
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1121
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1122
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1123
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1124
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1125
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1126
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1127
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1128
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e112a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e112c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e112e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1130
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1133
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1134
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1135
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1136
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1137
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1138
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1139
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e113f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1140
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1141
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1142
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1143
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1144
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1145
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1146
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1147
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1148
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1149
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e114f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1150
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1151
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1152
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1153
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1154
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1155
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1156
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1157
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1158
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1159
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e115f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1160
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1161
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1162
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1163
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1164
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1165
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1166
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1167
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1168
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1169
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e116f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1170
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1171
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1172
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1173
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1174
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1175
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1176
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1177
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1178
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1179
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e117f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1180
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1181
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1182
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1183
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1184
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1185
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1186
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1187
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1188
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1189
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e118f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1190
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1191
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1192
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1193
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1194
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1195
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1196
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1197
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1198
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e1199
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119a
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119b
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119c
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119d
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119e
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e119f
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a0
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a1
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a2
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a3
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a4
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a5
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a6
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a7
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a8
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11a9
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11aa
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11ab
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11ac
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11ad
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11ae
11/22/2024 12:35:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9a11fb139cb87e11af
11/22/2024 12:35:30 PM UTC [INFO] Received an event for node: 67406cfa11fb139cb87dfa0e
11/22/2024 12:35:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfa11fb139cb87dfa0e
11/22/2024 12:35:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9c11fb139cb87e11b5
11/22/2024 12:35:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9c11fb139cb87e11b6
11/22/2024 12:35:34 PM UTC [INFO] Received an event for node: 67406d0211fb139cb87dfa4c
11/22/2024 12:36:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:faee94d4a481cb5e71e35f93fb7f16505481a6e4', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406d0211fb139cb87dfa4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:36:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:88fa715a37a9a4862ffd1e2e10547e6e10d36442', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1205', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:36:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54688f4f94db8b113246d44fddafc42ec209c2a9', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:36:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:53c112ccb896a04cf4d438fbea27db03f5230f65', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1208', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0211fb139cb87dfa4c
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11bc
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11bd
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11be
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11bf
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c0
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c1
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c2
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c3
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c4
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c5
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c6
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c7
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c8
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11c9
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ca
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11cb
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11cc
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11cd
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ce
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11cf
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d0
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d1
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d2
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d3
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d4
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d5
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d6
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d7
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d8
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11d9
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11da
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11db
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11dc
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11dd
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11de
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11df
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e0
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e1
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e2
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e3
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e4
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e5
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e6
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e7
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e8
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11e9
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ea
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11eb
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ec
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ed
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ee
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ef
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f0
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f1
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f2
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f3
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f4
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f5
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f6
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f7
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f8
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11f9
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11fa
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11fb
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11fc
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11fd
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11fe
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11ff
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1200
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1201
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1202
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1203
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1204
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1205
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1206
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1207
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1208
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1209
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120a
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120b
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120c
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120d
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120e
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e120f
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1210
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1211
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1212
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1213
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1214
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1215
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1216
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1217
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1218
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1219
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121a
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121b
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121c
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121d
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121e
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e121f
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1220
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1221
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1222
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1223
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1224
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1225
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1226
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1227
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1228
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1229
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122a
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122b
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122c
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122d
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122e
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e122f
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1230
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1231
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1232
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1233
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1234
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1235
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1236
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1237
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1238
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1239
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e123a
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e123b
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e123c
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:faee94d4a481cb5e71e35f93fb7f16505481a6e4
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88fa715a37a9a4862ffd1e2e10547e6e10d36442
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54688f4f94db8b113246d44fddafc42ec209c2a9
11/22/2024 12:36:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53c112ccb896a04cf4d438fbea27db03f5230f65
11/22/2024 12:36:37 PM UTC [INFO] Received an event for node: 67406cfc11fb139cb87dfa20
11/22/2024 12:36:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfc11fb139cb87dfa20
11/22/2024 12:36:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1322
11/22/2024 12:36:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1325
11/22/2024 12:36:39 PM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa58
11/22/2024 12:37:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa58
11/22/2024 12:37:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c1
11/22/2024 12:37:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c5
11/22/2024 12:37:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c6
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa58
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1242
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1243
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1244
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1245
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1246
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1247
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1248
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1249
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124a
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124b
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124c
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124d
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124e
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e124f
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1250
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1251
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1252
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1253
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1255
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1257
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1259
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125b
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125d
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125f
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1262
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1264
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1266
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1268
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126a
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126c
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126e
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1270
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1272
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1274
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1276
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1277
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1278
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127a
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127b
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127d
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127e
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1280
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1281
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1282
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1283
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1284
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1286
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128b
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128e
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1290
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1292
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1294
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1296
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1298
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129a
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129c
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129e
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a0
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a2
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a3
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a7
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a9
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ab
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ad
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12af
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b1
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b3
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b7
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b9
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12bb
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12bd
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c1
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c3
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c6
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c8
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ca
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12cc
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ce
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d1
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d3
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d7
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d9
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12db
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12dd
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e1
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e3
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e7
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e9
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12eb
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ed
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ef
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f1
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f2
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f4
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f5
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f7
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12fa
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12fc
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12fe
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1300
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1302
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1304
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1305
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1306
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1308
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130a
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130c
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130f
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1311
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1313
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1315
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1317
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1319
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e131b
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e131d
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1320
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1323
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1326
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1329
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e132c
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e132f
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1332
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1334
11/22/2024 12:37:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1341
11/22/2024 12:37:36 PM UTC [INFO] Received an event for node: 67406d0811fb139cb87dfa73
11/22/2024 12:38:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0811fb139cb87dfa73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0811fb139cb87dfa73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:38:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:38:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc914bf5b04a8686435e15660cd76baa89619db8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc914bf5b04a8686435e15660cd76baa89619db8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:38:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:feef826d4118edf136d1284f7a59a2146657372d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:feef826d4118edf136d1284f7a59a2146657372d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0811fb139cb87dfa73
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1256
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1258
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125c
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e125e
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1260
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1261
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1263
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1265
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1267
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1269
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e126f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1271
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1273
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1275
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1279
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127c
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e127f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1285
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1287
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1288
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1289
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128c
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e128f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1291
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1293
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1295
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1297
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1299
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e129f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a1
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a4
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a6
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12a8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12aa
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ac
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ae
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b0
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b2
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b4
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b6
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12b8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ba
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12bc
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12be
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12bf
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c0
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c2
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c4
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c7
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c9
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12cb
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12cd
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12cf
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d0
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d2
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d4
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d6
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12d8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12da
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12dc
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12de
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12df
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e0
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e2
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e4
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e6
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ea
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ec
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ee
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f0
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f3
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f6
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12f9
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12fb
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12fd
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ff
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1301
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1303
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1307
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1309
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e130e
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1310
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1312
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1314
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1316
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1318
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e131a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e131c
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e131e
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1321
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1324
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1327
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e132b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e132d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1330
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1333
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1335
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1336
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1337
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1338
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1339
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133c
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133e
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e133f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1340
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1342
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1345
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1346
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1348
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1349
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e134a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e134b
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e134d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e134e
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e134f
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc914bf5b04a8686435e15660cd76baa89619db8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc914bf5b04a8686435e15660cd76baa89619db8
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feef826d4118edf136d1284f7a59a2146657372d
11/22/2024 12:38:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feef826d4118edf136d1284f7a59a2146657372d
11/22/2024 12:38:37 PM UTC [INFO] Received an event for node: 67406e1a11fb139cb87e01b1
11/22/2024 12:38:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1a11fb139cb87e01b1
11/22/2024 12:38:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1355
11/22/2024 12:38:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1356
11/22/2024 12:38:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1357
11/22/2024 12:38:40 PM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa46
11/22/2024 12:39:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa46
11/22/2024 12:39:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a6
11/22/2024 12:39:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a8
11/22/2024 12:39:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a9
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa46
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e135d
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e135e
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e135f
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1360
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1361
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1362
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1363
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1364
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1365
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1366
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1367
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1368
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1369
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136a
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136b
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136c
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136d
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136e
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e136f
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1370
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1371
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1372
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1373
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1374
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1375
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1376
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1377
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1378
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1379
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137a
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137b
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137c
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137d
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137e
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e137f
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1380
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1381
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1382
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1383
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1384
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1385
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1386
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1387
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1388
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1389
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138a
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138b
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138c
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138d
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138e
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e138f
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1390
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1391
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1392
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1393
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1394
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1395
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1396
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1397
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1398
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e1399
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139a
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139b
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139c
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139d
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139e
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e139f
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a0
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a1
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a2
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a3
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a4
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a5
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a6
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a7
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a8
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a9
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13aa
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ab
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ac
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ad
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ae
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13af
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b0
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b1
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b2
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b3
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b4
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b5
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b6
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b7
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b8
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13b9
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ba
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13bb
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13bc
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13bd
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13be
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13bf
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c0
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c1
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c2
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c3
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c4
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c5
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c6
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c7
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c8
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13c9
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ca
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13cb
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13cc
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13cd
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13ce
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13cf
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d0
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d1
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d2
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d3
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d4
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d5
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d6
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d7
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d8
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13d9
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13da
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13db
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13dc
11/22/2024 12:39:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13dd
11/22/2024 12:39:42 PM UTC [INFO] Received an event for node: 67406ce911fb139cb87df99c
11/22/2024 12:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce911fb139cb87df99c
11/22/2024 12:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ab
11/22/2024 12:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ae
11/22/2024 12:39:44 PM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa6a
11/22/2024 12:40:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0711fb139cb87dfa6a
11/22/2024 12:40:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146e
11/22/2024 12:40:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1475
11/22/2024 12:40:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1477
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa6a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e3
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e4
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e6
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e8
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ea
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ec
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ee
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f0
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f1
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f3
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f5
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f7
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f8
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13fa
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13fc
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13fe
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ff
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1400
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1402
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1404
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1406
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1408
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1409
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140e
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1410
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1412
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1414
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1416
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1418
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1420
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1422
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1424
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1426
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1428
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142e
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1430
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1432
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1434
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1436
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1438
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143d
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143f
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1442
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1443
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1445
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1447
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1449
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144b
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144d
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144f
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1451
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1453
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1455
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1457
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1459
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145b
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145d
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145f
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1461
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1463
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1465
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1467
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1469
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146b
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146e
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1470
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1475
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1477
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1479
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147b
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147d
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147f
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1481
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1483
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1485
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1487
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1489
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148b
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148e
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148f
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1490
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1491
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1492
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1494
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1496
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1498
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149a
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149c
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149e
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a0
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a1
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a4
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a6
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a9
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ac
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b0
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b3
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b6
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b9
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14bb
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14bc
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14bd
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c0
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c3
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c5
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c7
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c8
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ca
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d1
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d3
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d4
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d7
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d9
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14db
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14dc
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14df
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e0
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e2
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e4
11/22/2024 12:40:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e6
11/22/2024 12:40:46 PM UTC [INFO] Received an event for node: 67406d0c11fb139cb87dfa8e
11/22/2024 12:42:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0c11fb139cb87dfa8e
11/22/2024 12:42:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e13fb
11/22/2024 12:42:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e13fd
11/22/2024 12:42:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1401
11/22/2024 12:42:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1403
11/22/2024 12:42:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1405
11/22/2024 12:42:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1407
11/22/2024 12:42:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e140b
11/22/2024 12:42:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e140d
11/22/2024 12:42:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e140f
11/22/2024 12:42:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1411
11/22/2024 12:42:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1413
11/22/2024 12:42:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1415
11/22/2024 12:42:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1417
11/22/2024 12:42:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1419
11/22/2024 12:42:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e141b
11/22/2024 12:42:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e141d
11/22/2024 12:42:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e141e
11/22/2024 12:42:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e141f
11/22/2024 12:42:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1421
11/22/2024 12:42:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1423
11/22/2024 12:42:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1425
11/22/2024 12:42:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1427
11/22/2024 12:42:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1429
11/22/2024 12:42:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e142b
11/22/2024 12:42:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e142d
11/22/2024 12:42:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e142f
11/22/2024 12:42:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1431
11/22/2024 12:42:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1433
11/22/2024 12:42:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1435
11/22/2024 12:42:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1437
11/22/2024 12:42:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1439
11/22/2024 12:42:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e143b
11/22/2024 12:42:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e143e
11/22/2024 12:42:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1440
11/22/2024 12:42:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1441
11/22/2024 12:42:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1444
11/22/2024 12:42:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1446
11/22/2024 12:42:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1448
11/22/2024 12:42:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e144a
11/22/2024 12:42:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e144c
11/22/2024 12:42:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e144e
11/22/2024 12:42:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1450
11/22/2024 12:42:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1452
11/22/2024 12:42:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1454
11/22/2024 12:42:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1456
11/22/2024 12:42:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1458
11/22/2024 12:42:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e145a
11/22/2024 12:42:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e145e
11/22/2024 12:42:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1460
11/22/2024 12:42:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1462
11/22/2024 12:42:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1464
11/22/2024 12:42:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1466
11/22/2024 12:42:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1468
11/22/2024 12:42:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146a
11/22/2024 12:42:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146c
11/22/2024 12:42:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146d
11/22/2024 12:42:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146f
11/22/2024 12:42:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1471
11/22/2024 12:42:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1472
11/22/2024 12:42:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1473
11/22/2024 12:42:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1474
11/22/2024 12:42:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1476
11/22/2024 12:42:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1478
11/22/2024 12:42:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e147a
11/22/2024 12:42:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e147c
11/22/2024 12:42:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e147e
11/22/2024 12:42:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1480
11/22/2024 12:42:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1482
11/22/2024 12:42:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1484
11/22/2024 12:42:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1486
11/22/2024 12:42:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1488
11/22/2024 12:42:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e148a
11/22/2024 12:42:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e148c
11/22/2024 12:42:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e148d
11/22/2024 12:42:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1493
11/22/2024 12:42:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1495
11/22/2024 12:42:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1497
11/22/2024 12:42:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1499
11/22/2024 12:42:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e149b
11/22/2024 12:42:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e149d
11/22/2024 12:42:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e149f
11/22/2024 12:43:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14a2
11/22/2024 12:43:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14a3
11/22/2024 12:43:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14a5
11/22/2024 12:43:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14a7
11/22/2024 12:43:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14aa
11/22/2024 12:43:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ad
11/22/2024 12:43:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14af
11/22/2024 12:43:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14b1
11/22/2024 12:43:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14b4
11/22/2024 12:43:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14b8
11/22/2024 12:43:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ba
11/22/2024 12:43:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14be
11/22/2024 12:43:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14bf
11/22/2024 12:43:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14c1
11/22/2024 12:43:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14c4
11/22/2024 12:43:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14c6
11/22/2024 12:43:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14c9
11/22/2024 12:43:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14cb
11/22/2024 12:43:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14cc
11/22/2024 12:43:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14cd
11/22/2024 12:43:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ce
11/22/2024 12:43:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14cf
11/22/2024 12:43:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14d0
11/22/2024 12:43:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14d2
11/22/2024 12:43:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14d5
11/22/2024 12:43:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14d6
11/22/2024 12:43:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14d8
11/22/2024 12:43:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14da
11/22/2024 12:43:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14dd
11/22/2024 12:43:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14de
11/22/2024 12:43:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14e1
11/22/2024 12:43:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14e3
11/22/2024 12:43:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14e5
11/22/2024 12:43:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14e7
11/22/2024 12:43:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14e9
11/22/2024 12:43:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14eb
11/22/2024 12:43:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ed
11/22/2024 12:43:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ef
11/22/2024 12:43:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f0
11/22/2024 12:43:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f1
11/22/2024 12:43:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f2
11/22/2024 12:43:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f3
11/22/2024 12:43:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f4
11/22/2024 12:43:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f5
11/22/2024 12:43:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f6
11/22/2024 12:43:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f7
11/22/2024 12:43:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f8
11/22/2024 12:43:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14f9
11/22/2024 12:43:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14fa
11/22/2024 12:43:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14fb
11/22/2024 12:43:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14fc
11/22/2024 12:43:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14fd
11/22/2024 12:43:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14fe
11/22/2024 12:43:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e14ff
11/22/2024 12:43:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1500
11/22/2024 12:43:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1501
11/22/2024 12:43:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1502
11/22/2024 12:43:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1503
11/22/2024 12:43:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1504
11/22/2024 12:43:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1505
11/22/2024 12:43:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1506
11/22/2024 12:43:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1507
11/22/2024 12:43:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1508
11/22/2024 12:43:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1509
11/22/2024 12:43:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150a
11/22/2024 12:43:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150b
11/22/2024 12:43:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150c
11/22/2024 12:43:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150d
11/22/2024 12:43:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150e
11/22/2024 12:43:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e150f
11/22/2024 12:43:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1510
11/22/2024 12:43:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1511
11/22/2024 12:43:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1512
11/22/2024 12:43:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1513
11/22/2024 12:43:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1514
11/22/2024 12:43:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1515
11/22/2024 12:43:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1516
11/22/2024 12:43:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1517
11/22/2024 12:43:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1518
11/22/2024 12:43:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1519
11/22/2024 12:43:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151a
11/22/2024 12:43:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151b
11/22/2024 12:43:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151c
11/22/2024 12:43:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151d
11/22/2024 12:43:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151e
11/22/2024 12:43:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e151f
11/22/2024 12:43:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1520
11/22/2024 12:43:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1521
11/22/2024 12:43:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1522
11/22/2024 12:43:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1523
11/22/2024 12:43:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1524
11/22/2024 12:43:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1525
11/22/2024 12:43:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1526
11/22/2024 12:43:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1527
11/22/2024 12:43:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1528
11/22/2024 12:43:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1529
11/22/2024 12:43:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152a
11/22/2024 12:43:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152b
11/22/2024 12:43:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152c
11/22/2024 12:43:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152d
11/22/2024 12:43:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152e
11/22/2024 12:43:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e152f
11/22/2024 12:43:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1530
11/22/2024 12:43:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1531
11/22/2024 12:43:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1532
11/22/2024 12:43:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1533
11/22/2024 12:43:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1534
11/22/2024 12:43:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1535
11/22/2024 12:43:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1536
11/22/2024 12:43:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1537
11/22/2024 12:43:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1538
11/22/2024 12:43:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1539
11/22/2024 12:43:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153a
11/22/2024 12:43:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153b
11/22/2024 12:43:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153c
11/22/2024 12:43:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153d
11/22/2024 12:43:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153e
11/22/2024 12:43:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e153f
11/22/2024 12:43:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1540
11/22/2024 12:43:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1541
11/22/2024 12:43:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1542
11/22/2024 12:43:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1543
11/22/2024 12:43:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1544
11/22/2024 12:43:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1545
11/22/2024 12:43:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1546
11/22/2024 12:43:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1547
11/22/2024 12:43:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1548
11/22/2024 12:43:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1549
11/22/2024 12:43:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154a
11/22/2024 12:43:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154b
11/22/2024 12:43:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154c
11/22/2024 12:43:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154d
11/22/2024 12:43:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154e
11/22/2024 12:43:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e154f
11/22/2024 12:43:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1550
11/22/2024 12:43:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1551
11/22/2024 12:43:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1552
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0c11fb139cb87dfa8e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e7
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e9
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13eb
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ed
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13ef
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f2
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f4
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f6
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13f9
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13fb
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13fd
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1401
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1403
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1405
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1407
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e140f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1411
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1413
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1415
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1417
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1419
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e141f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1421
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1423
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1425
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1427
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1429
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e142f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1431
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1433
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1435
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1437
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1439
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e143e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1440
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1441
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1444
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1446
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1448
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e144e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1450
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1452
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1454
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1456
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1458
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e145e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1460
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1462
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1464
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1466
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1468
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1471
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1472
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1473
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1474
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1476
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1478
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e147e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1480
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1482
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1484
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1486
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1488
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e148d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1493
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1495
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1497
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1499
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e149f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a2
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a3
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a5
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14a7
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14aa
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ad
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14af
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b1
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b4
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14b8
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ba
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14be
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14bf
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c1
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c4
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c6
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14c9
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14cb
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14cc
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14cd
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ce
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14cf
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d0
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d2
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d5
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d6
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14d8
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14da
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14dd
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14de
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e1
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e3
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e5
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e7
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14e9
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14eb
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ed
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ef
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f0
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f1
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f2
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f3
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f4
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f5
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f6
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f7
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f8
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14f9
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14fa
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14fb
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14fc
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14fd
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14fe
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e14ff
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1500
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1501
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1502
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1503
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1504
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1505
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1506
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1507
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1508
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1509
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e150f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1510
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1511
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1512
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1513
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1514
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1515
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1516
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1517
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1518
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1519
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e151f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1520
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1521
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1522
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1523
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1524
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1525
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1526
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1527
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1528
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1529
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e152f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1530
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1531
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1532
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1533
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1534
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1535
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1536
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1537
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1538
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1539
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e153f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1540
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1541
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1542
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1543
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1544
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1545
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1546
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1547
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1548
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1549
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154a
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154b
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154c
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154d
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154e
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e154f
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1550
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1551
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1552
11/22/2024 12:43:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1553
11/22/2024 12:43:42 PM UTC [INFO] Received an event for node: 67406d0b11fb139cb87dfa85
11/22/2024 12:45:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0b11fb139cb87dfa85
11/22/2024 12:45:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1562
11/22/2024 12:45:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1563
11/22/2024 12:45:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1564
11/22/2024 12:45:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1565
11/22/2024 12:45:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1566
11/22/2024 12:45:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1567
11/22/2024 12:45:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1568
11/22/2024 12:45:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1569
11/22/2024 12:45:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156a
11/22/2024 12:45:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156b
11/22/2024 12:45:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156c
11/22/2024 12:45:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156d
11/22/2024 12:45:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156e
11/22/2024 12:45:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e156f
11/22/2024 12:45:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1570
11/22/2024 12:45:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1571
11/22/2024 12:45:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1572
11/22/2024 12:45:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1573
11/22/2024 12:45:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1574
11/22/2024 12:45:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1575
11/22/2024 12:45:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1576
11/22/2024 12:45:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1577
11/22/2024 12:45:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1578
11/22/2024 12:45:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1579
11/22/2024 12:45:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157a
11/22/2024 12:45:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157b
11/22/2024 12:45:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157c
11/22/2024 12:45:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157d
11/22/2024 12:45:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157e
11/22/2024 12:45:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e157f
11/22/2024 12:45:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1580
11/22/2024 12:45:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1581
11/22/2024 12:45:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1582
11/22/2024 12:45:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1583
11/22/2024 12:45:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1584
11/22/2024 12:45:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1585
11/22/2024 12:45:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1586
11/22/2024 12:45:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1587
11/22/2024 12:45:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1588
11/22/2024 12:45:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1589
11/22/2024 12:45:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158a
11/22/2024 12:45:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158b
11/22/2024 12:45:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158c
11/22/2024 12:45:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158d
11/22/2024 12:45:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158e
11/22/2024 12:45:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e158f
11/22/2024 12:45:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1590
11/22/2024 12:45:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1591
11/22/2024 12:45:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1592
11/22/2024 12:45:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1593
11/22/2024 12:45:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1594
11/22/2024 12:45:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1595
11/22/2024 12:45:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1596
11/22/2024 12:45:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1597
11/22/2024 12:45:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1598
11/22/2024 12:45:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1599
11/22/2024 12:45:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159a
11/22/2024 12:45:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159b
11/22/2024 12:45:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159c
11/22/2024 12:45:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159d
11/22/2024 12:45:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159e
11/22/2024 12:45:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e159f
11/22/2024 12:45:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a0
11/22/2024 12:45:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a1
11/22/2024 12:45:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a2
11/22/2024 12:45:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a3
11/22/2024 12:45:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a4
11/22/2024 12:45:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a5
11/22/2024 12:45:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a6
11/22/2024 12:45:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a7
11/22/2024 12:45:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a8
11/22/2024 12:46:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15a9
11/22/2024 12:46:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15aa
11/22/2024 12:46:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ab
11/22/2024 12:46:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ac
11/22/2024 12:46:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ad
11/22/2024 12:46:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ae
11/22/2024 12:46:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15af
11/22/2024 12:46:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b0
11/22/2024 12:46:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b1
11/22/2024 12:46:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b2
11/22/2024 12:46:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b3
11/22/2024 12:46:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b4
11/22/2024 12:46:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b5
11/22/2024 12:46:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b6
11/22/2024 12:46:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b7
11/22/2024 12:46:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b8
11/22/2024 12:46:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15b9
11/22/2024 12:46:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ba
11/22/2024 12:46:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15bb
11/22/2024 12:46:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15bc
11/22/2024 12:46:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15bd
11/22/2024 12:46:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15be
11/22/2024 12:46:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15bf
11/22/2024 12:46:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c0
11/22/2024 12:46:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c1
11/22/2024 12:46:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c2
11/22/2024 12:46:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c3
11/22/2024 12:46:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c4
11/22/2024 12:46:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c5
11/22/2024 12:46:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c6
11/22/2024 12:46:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c7
11/22/2024 12:46:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c8
11/22/2024 12:46:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15c9
11/22/2024 12:46:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ca
11/22/2024 12:46:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15cb
11/22/2024 12:46:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15cc
11/22/2024 12:46:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15cd
11/22/2024 12:46:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ce
11/22/2024 12:46:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15cf
11/22/2024 12:46:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d0
11/22/2024 12:46:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d1
11/22/2024 12:46:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d2
11/22/2024 12:46:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d3
11/22/2024 12:46:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d4
11/22/2024 12:46:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d5
11/22/2024 12:46:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d6
11/22/2024 12:46:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d7
11/22/2024 12:46:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d8
11/22/2024 12:46:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15d9
11/22/2024 12:46:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15da
11/22/2024 12:46:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15db
11/22/2024 12:46:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15dc
11/22/2024 12:46:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15dd
11/22/2024 12:46:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15de
11/22/2024 12:46:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15df
11/22/2024 12:46:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e0
11/22/2024 12:46:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e1
11/22/2024 12:46:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e2
11/22/2024 12:46:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e3
11/22/2024 12:46:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e4
11/22/2024 12:46:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e5
11/22/2024 12:46:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e6
11/22/2024 12:46:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e7
11/22/2024 12:46:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e8
11/22/2024 12:46:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15e9
11/22/2024 12:46:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ea
11/22/2024 12:46:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15eb
11/22/2024 12:46:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ec
11/22/2024 12:46:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ed
11/22/2024 12:46:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ee
11/22/2024 12:46:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ef
11/22/2024 12:46:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f0
11/22/2024 12:46:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f1
11/22/2024 12:46:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f2
11/22/2024 12:46:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f3
11/22/2024 12:46:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f4
11/22/2024 12:46:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f5
11/22/2024 12:46:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f6
11/22/2024 12:46:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f7
11/22/2024 12:46:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f8
11/22/2024 12:46:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15f9
11/22/2024 12:46:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15fa
11/22/2024 12:46:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15fb
11/22/2024 12:46:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15fc
11/22/2024 12:46:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15fd
11/22/2024 12:46:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15fe
11/22/2024 12:46:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e15ff
11/22/2024 12:46:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1600
11/22/2024 12:46:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1601
11/22/2024 12:46:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1602
11/22/2024 12:46:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1603
11/22/2024 12:46:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1604
11/22/2024 12:46:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1605
11/22/2024 12:46:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1606
11/22/2024 12:46:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1607
11/22/2024 12:46:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1608
11/22/2024 12:46:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1609
11/22/2024 12:46:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160a
11/22/2024 12:46:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160b
11/22/2024 12:46:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160c
11/22/2024 12:46:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160d
11/22/2024 12:46:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160e
11/22/2024 12:46:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e160f
11/22/2024 12:46:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1610
11/22/2024 12:46:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1611
11/22/2024 12:46:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1612
11/22/2024 12:46:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1613
11/22/2024 12:46:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1614
11/22/2024 12:46:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1615
11/22/2024 12:46:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1616
11/22/2024 12:46:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1617
11/22/2024 12:46:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1618
11/22/2024 12:46:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1619
11/22/2024 12:46:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161a
11/22/2024 12:46:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161b
11/22/2024 12:46:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161c
11/22/2024 12:46:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161d
11/22/2024 12:46:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161e
11/22/2024 12:46:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e161f
11/22/2024 12:46:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1620
11/22/2024 12:46:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1621
11/22/2024 12:46:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1622
11/22/2024 12:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1623
11/22/2024 12:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1624
11/22/2024 12:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1625
11/22/2024 12:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1626
11/22/2024 12:46:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1627
11/22/2024 12:46:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1628
11/22/2024 12:46:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1629
11/22/2024 12:46:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162a
11/22/2024 12:46:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162b
11/22/2024 12:46:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162c
11/22/2024 12:46:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162d
11/22/2024 12:46:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162e
11/22/2024 12:46:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e162f
11/22/2024 12:46:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1630
11/22/2024 12:46:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1631
11/22/2024 12:46:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1632
11/22/2024 12:46:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1633
11/22/2024 12:46:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1634
11/22/2024 12:46:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1635
11/22/2024 12:46:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1636
11/22/2024 12:46:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1637
11/22/2024 12:46:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1638
11/22/2024 12:46:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e1639
11/22/2024 12:46:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e163a
11/22/2024 12:46:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea711fb139cb87e163b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0b11fb139cb87dfa85
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1559
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e155f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1560
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1561
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1562
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1563
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1564
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1565
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1566
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1567
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1568
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1569
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e156f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1570
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1571
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1572
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1573
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1574
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1575
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1576
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1577
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1578
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1579
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e157f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1580
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1581
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1582
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1583
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1584
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1585
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1586
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1587
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1588
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1589
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e158f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1590
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1591
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1592
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1593
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1594
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1595
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1596
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1597
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1598
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1599
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e159f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15a9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15aa
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ab
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ac
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ad
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ae
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15af
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15b9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ba
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15bb
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15bc
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15bd
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15be
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15bf
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15c9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ca
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15cb
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15cc
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15cd
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ce
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15cf
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15d9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15da
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15db
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15dc
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15dd
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15de
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15df
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15e9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ea
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15eb
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ec
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ed
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ee
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ef
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f0
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f1
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f2
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f3
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f4
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f5
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f6
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f7
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f8
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15f9
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15fa
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15fb
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15fc
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15fd
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15fe
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e15ff
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1600
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1601
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1602
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1603
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1604
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1605
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1606
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1607
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1608
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1609
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e160f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1610
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1611
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1612
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1613
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1614
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1615
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1616
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1617
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1618
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1619
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e161f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1620
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1621
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1622
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1623
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1624
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1625
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1626
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1627
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1628
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1629
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162c
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162d
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162e
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e162f
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1630
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1631
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1632
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1633
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1634
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1635
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1636
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1637
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1638
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e1639
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e163a
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e163b
11/22/2024 12:46:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea711fb139cb87e163c
11/22/2024 12:46:45 PM UTC [INFO] Received an event for node: 67406e2011fb139cb87e02a9
11/22/2024 12:46:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2011fb139cb87e02a9
11/22/2024 12:46:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1649
11/22/2024 12:46:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164b
11/22/2024 12:46:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164d
11/22/2024 12:46:48 PM UTC [INFO] Received an event for node: 67406d1411fb139cb87dfacc
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1411fb139cb87dfacc
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1647
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164c
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164f
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1651
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1654
11/22/2024 12:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1656
11/22/2024 12:46:52 PM UTC [INFO] Received an event for node: 67406d0f11fb139cb87dfaae
11/22/2024 12:49:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0f11fb139cb87dfaae
11/22/2024 12:49:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e165d
11/22/2024 12:49:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e165f
11/22/2024 12:49:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1660
11/22/2024 12:49:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1661
11/22/2024 12:49:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1662
11/22/2024 12:49:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1663
11/22/2024 12:49:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1664
11/22/2024 12:49:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1665
11/22/2024 12:49:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1666
11/22/2024 12:49:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1667
11/22/2024 12:49:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1668
11/22/2024 12:49:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1669
11/22/2024 12:49:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166a
11/22/2024 12:49:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166b
11/22/2024 12:49:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166c
11/22/2024 12:49:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166d
11/22/2024 12:49:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166e
11/22/2024 12:49:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e166f
11/22/2024 12:49:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1670
11/22/2024 12:49:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1671
11/22/2024 12:49:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1672
11/22/2024 12:49:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1673
11/22/2024 12:49:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1674
11/22/2024 12:49:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1675
11/22/2024 12:49:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1676
11/22/2024 12:49:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1677
11/22/2024 12:49:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1678
11/22/2024 12:49:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1679
11/22/2024 12:49:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167a
11/22/2024 12:49:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167b
11/22/2024 12:49:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167c
11/22/2024 12:49:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167d
11/22/2024 12:49:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167e
11/22/2024 12:49:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e167f
11/22/2024 12:49:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1680
11/22/2024 12:49:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1681
11/22/2024 12:49:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1682
11/22/2024 12:49:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1683
11/22/2024 12:49:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1684
11/22/2024 12:49:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1685
11/22/2024 12:49:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1686
11/22/2024 12:49:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1687
11/22/2024 12:49:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1688
11/22/2024 12:49:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1689
11/22/2024 12:49:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168a
11/22/2024 12:49:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168b
11/22/2024 12:49:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168c
11/22/2024 12:49:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168d
11/22/2024 12:49:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168e
11/22/2024 12:49:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e168f
11/22/2024 12:49:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1690
11/22/2024 12:49:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1691
11/22/2024 12:49:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1692
11/22/2024 12:49:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1693
11/22/2024 12:49:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1694
11/22/2024 12:49:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1695
11/22/2024 12:49:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1696
11/22/2024 12:49:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1697
11/22/2024 12:49:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1698
11/22/2024 12:49:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1699
11/22/2024 12:49:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169a
11/22/2024 12:49:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169b
11/22/2024 12:49:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169c
11/22/2024 12:49:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169d
11/22/2024 12:49:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169e
11/22/2024 12:49:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e169f
11/22/2024 12:49:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a0
11/22/2024 12:49:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a1
11/22/2024 12:49:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a2
11/22/2024 12:49:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a3
11/22/2024 12:49:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a4
11/22/2024 12:49:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a5
11/22/2024 12:49:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a6
11/22/2024 12:49:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a7
11/22/2024 12:49:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a8
11/22/2024 12:49:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16a9
11/22/2024 12:49:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16aa
11/22/2024 12:49:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ab
11/22/2024 12:49:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ac
11/22/2024 12:49:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ad
11/22/2024 12:49:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ae
11/22/2024 12:49:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16af
11/22/2024 12:49:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b0
11/22/2024 12:49:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b1
11/22/2024 12:49:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b2
11/22/2024 12:49:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b3
11/22/2024 12:49:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b4
11/22/2024 12:49:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b5
11/22/2024 12:49:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b6
11/22/2024 12:49:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b7
11/22/2024 12:49:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b8
11/22/2024 12:49:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16b9
11/22/2024 12:49:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ba
11/22/2024 12:49:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16bb
11/22/2024 12:49:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16bc
11/22/2024 12:49:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16bd
11/22/2024 12:49:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16be
11/22/2024 12:49:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16bf
11/22/2024 12:49:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c0
11/22/2024 12:49:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c1
11/22/2024 12:49:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c2
11/22/2024 12:49:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c3
11/22/2024 12:49:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c4
11/22/2024 12:49:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c5
11/22/2024 12:49:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c6
11/22/2024 12:49:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c7
11/22/2024 12:49:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c8
11/22/2024 12:49:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16c9
11/22/2024 12:49:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ca
11/22/2024 12:49:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16cb
11/22/2024 12:49:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16cc
11/22/2024 12:49:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16cd
11/22/2024 12:49:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ce
11/22/2024 12:49:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16cf
11/22/2024 12:49:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d0
11/22/2024 12:49:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d1
11/22/2024 12:49:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d2
11/22/2024 12:49:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d3
11/22/2024 12:49:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d4
11/22/2024 12:49:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d5
11/22/2024 12:49:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d6
11/22/2024 12:49:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d7
11/22/2024 12:49:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d8
11/22/2024 12:49:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16d9
11/22/2024 12:49:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16da
11/22/2024 12:49:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16db
11/22/2024 12:49:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16dc
11/22/2024 12:49:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16dd
11/22/2024 12:49:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16de
11/22/2024 12:49:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16df
11/22/2024 12:49:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e0
11/22/2024 12:49:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e1
11/22/2024 12:49:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e2
11/22/2024 12:49:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e3
11/22/2024 12:49:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e4
11/22/2024 12:49:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e5
11/22/2024 12:49:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e6
11/22/2024 12:49:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e7
11/22/2024 12:49:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e8
11/22/2024 12:49:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16e9
11/22/2024 12:49:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ea
11/22/2024 12:49:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16eb
11/22/2024 12:49:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ec
11/22/2024 12:49:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ed
11/22/2024 12:49:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ee
11/22/2024 12:50:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ef
11/22/2024 12:50:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f0
11/22/2024 12:50:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f1
11/22/2024 12:50:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f2
11/22/2024 12:50:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f3
11/22/2024 12:50:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f4
11/22/2024 12:50:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f5
11/22/2024 12:50:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f6
11/22/2024 12:50:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f7
11/22/2024 12:50:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f8
11/22/2024 12:50:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16f9
11/22/2024 12:50:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16fa
11/22/2024 12:50:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16fb
11/22/2024 12:50:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16fc
11/22/2024 12:50:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16fd
11/22/2024 12:50:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16fe
11/22/2024 12:50:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e16ff
11/22/2024 12:50:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1700
11/22/2024 12:50:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1701
11/22/2024 12:50:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1702
11/22/2024 12:50:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1703
11/22/2024 12:50:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1704
11/22/2024 12:50:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1705
11/22/2024 12:50:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1706
11/22/2024 12:50:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1707
11/22/2024 12:50:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1708
11/22/2024 12:50:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1709
11/22/2024 12:50:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170a
11/22/2024 12:50:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170b
11/22/2024 12:50:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170c
11/22/2024 12:50:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170d
11/22/2024 12:50:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170e
11/22/2024 12:50:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e170f
11/22/2024 12:50:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1710
11/22/2024 12:50:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1711
11/22/2024 12:50:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1712
11/22/2024 12:50:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1713
11/22/2024 12:50:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1714
11/22/2024 12:50:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1715
11/22/2024 12:50:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1716
11/22/2024 12:50:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1717
11/22/2024 12:50:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1718
11/22/2024 12:50:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1719
11/22/2024 12:50:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171a
11/22/2024 12:50:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171b
11/22/2024 12:50:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171c
11/22/2024 12:50:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171d
11/22/2024 12:50:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171e
11/22/2024 12:50:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e171f
11/22/2024 12:50:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1720
11/22/2024 12:50:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1721
11/22/2024 12:50:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1722
11/22/2024 12:50:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1723
11/22/2024 12:50:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1724
11/22/2024 12:50:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1725
11/22/2024 12:50:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1726
11/22/2024 12:50:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1727
11/22/2024 12:50:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1728
11/22/2024 12:50:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1729
11/22/2024 12:50:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172a
11/22/2024 12:50:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172b
11/22/2024 12:50:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172c
11/22/2024 12:50:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172d
11/22/2024 12:50:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172e
11/22/2024 12:50:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e172f
11/22/2024 12:50:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1730
11/22/2024 12:50:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1731
11/22/2024 12:50:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1732
11/22/2024 12:50:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1733
11/22/2024 12:50:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1734
11/22/2024 12:50:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1735
11/22/2024 12:50:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1736
11/22/2024 12:50:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eac11fb139cb87e1737
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0f11fb139cb87dfaae
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1648
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e164e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1650
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1653
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1655
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1657
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1659
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e165b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e165d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e165f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1660
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1661
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1662
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1663
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1664
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1665
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1666
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1667
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1668
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1669
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e166f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1670
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1671
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1672
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1673
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1674
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1675
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1676
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1677
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1678
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1679
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e167f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1680
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1681
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1682
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1683
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1684
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1685
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1686
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1687
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1688
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1689
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e168f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1690
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1691
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1692
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1693
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1694
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1695
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1696
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1697
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1698
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1699
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e169f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16a9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16aa
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ab
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ac
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ad
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ae
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16af
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16b9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ba
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16bb
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16bc
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16bd
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16be
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16bf
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16c9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ca
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16cb
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16cc
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16cd
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ce
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16cf
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16d9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16da
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16db
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16dc
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16dd
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16de
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16df
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16e9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ea
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16eb
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ec
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ed
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ee
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ef
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f0
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f1
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f2
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f3
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f4
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f5
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f6
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f7
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f8
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16f9
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16fa
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16fb
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16fc
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16fd
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16fe
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e16ff
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1700
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1701
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1702
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1703
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1704
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1705
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1706
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1707
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1708
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1709
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e170f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1710
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1711
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1712
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1713
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1714
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1715
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1716
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1717
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1718
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1719
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e171f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1720
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1721
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1722
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1723
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1724
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1725
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1726
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1727
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1728
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1729
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172a
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172b
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172c
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172d
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172e
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e172f
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1730
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1731
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1732
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1733
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1734
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1735
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1736
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1737
11/22/2024 12:50:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eac11fb139cb87e1738
11/22/2024 12:50:28 PM UTC [INFO] Received an event for node: 67406df211fb139cb87dff60
11/22/2024 12:50:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff60
11/22/2024 12:50:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e173e
11/22/2024 12:50:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e173f
11/22/2024 12:50:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e1740
11/22/2024 12:50:31 PM UTC [INFO] Received an event for node: 67406e1e11fb139cb87e01ba
11/22/2024 12:50:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1e11fb139cb87e01ba
11/22/2024 12:50:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e1749
11/22/2024 12:50:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e174a
11/22/2024 12:50:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e174b
11/22/2024 12:50:33 PM UTC [INFO] Received an event for node: 67406e1f11fb139cb87e02a6
11/22/2024 12:50:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1f11fb139cb87e02a6
11/22/2024 12:50:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e1751
11/22/2024 12:50:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e1752
11/22/2024 12:50:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ead11fb139cb87e1753
11/22/2024 12:50:36 PM UTC [INFO] Received an event for node: 67406d1811fb139cb87dfae7
11/22/2024 12:50:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1811fb139cb87dfae7
11/22/2024 12:50:37 PM UTC [INFO] Received an event for node: 67406d3011fb139cb87dfb63
11/22/2024 12:50:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3011fb139cb87dfb63
11/22/2024 12:50:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e175a
11/22/2024 12:50:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e175b
11/22/2024 12:50:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e175c
11/22/2024 12:50:40 PM UTC [INFO] Received an event for node: 67406d2f11fb139cb87dfb55
11/22/2024 12:50:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2f11fb139cb87dfb55
11/22/2024 12:50:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e1762
11/22/2024 12:50:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e1763
11/22/2024 12:50:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e1764
11/22/2024 12:50:42 PM UTC [INFO] Received an event for node: 67406df511fb139cb87dffb3
11/22/2024 12:50:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.233843] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.241762] Modules linked in:\n[    4.244825] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.256117] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.265243] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.269691] Code: 48 8b 15 c4 43 10 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.288443] RSP: 0018:ffff9e5400033b60 EFLAGS: 00010246\n[    4.293672] RAX: 0000000000000000 RBX: ffff966ec6fbbd08 RCX: 0000000000000000\n[    4.300803] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9e5400033bc0\n[    4.307934] RBP: ffff966ec6fbbd08 R08: ffff966ec6fb1fa0 R09: ffff966ec1c30000\n[    4.315064] R10: 0000000000000040 R11: ffffffffa352fd88 R12: ffff966ec6f80000\n[    4.322201] R13: ffff966ec6fb4fe0 R14: ffff9e5400033b68 R15: 0000000000000001\n[    4.329332] FS:  0000000000000000(0000) GS:ffff966eeaf00000(0000) knlGS:0000000000000000\n[    4.337421] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.343166] CR2: 0000000000000000 CR3: 00000000b2e28000 CR4: 00000000003506f0\n[    4.350298] Call Trace:\n[    4.352751]  <TASK>\n[    4.354856]  ? __warn+0x85/0x130\n[    4.358088]  ? __flush_work+0x29f/0x2c0\n[    4.361929]  ? report_bug+0x160/0x190\n[    4.365598]  ? handle_bug+0x53/0x90\n[    4.369093]  ? exc_invalid_op+0x13/0x60\n[    4.372933]  ? asm_exc_invalid_op+0x16/0x20\n[    4.377126]  ? __flush_work+0x29f/0x2c0\n[    4.380971]  cancel_delayed_work_sync+0x6e/0x90\n[    4.385503]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.390037]  amdgpu_ring_alloc+0x3f/0x60\n[    4.393968]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.399109]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.403557]  amdgpu_device_init+0x205f/0x26f0\n[    4.407918]  amdgpu_driver_load_kms+0x15/0x80\n[    4.412276]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.416291]  pci_device_probe+0x98/0x120\n[    4.420220]  really_probe+0xd1/0x2b0\n[    4.423804]  ? __device_attach_driver+0xc0/0xc0\n[    4.428335]  __driver_probe_device+0x73/0x120\n[    4.432694]  driver_probe_device+0x1f/0x90\n[    4.436795]  __driver_attach+0x84/0x130\n[    4.440635]  bus_for_each_dev+0x84/0xd0\n[    4.444476]  bus_add_driver+0xe4/0x210\n[    4.448231]  driver_register+0x55/0x100\n[    4.452069]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.456865]  do_one_initcall+0x57/0x300\n[    4.460707]  kernel_init_freeable+0x1be/0x300\n[    4.465071]  ? rest_init+0xc0/0xc0\n[    4.468479]  kernel_init+0x16/0x1b0\n[    4.471972]  ret_from_fork+0x30/0x50\n[    4.475555]  ? rest_init+0xc0/0xc0\n[    4.478959]  ret_from_fork_asm+0x11/0x20\n[    4.482890]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.679383] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.687306] Modules linked in:\n[    4.690370] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.703316] Tainted: [W]=WARN\n[    4.706286] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.715415] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.721864] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.726317] Code: 48 8b 15 c4 43 10 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.745069] RSP: 0018:ffff9e5400073c58 EFLAGS: 00010246\n[    4.750301] RAX: 0000000000000000 RBX: ffff966ec6fbbd08 RCX: 0000000000000000\n[    4.757439] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9e5400073cb8\n[    4.764574] RBP: ffff966ec6fbbd08 R08: ffff9e5400073de8 R09: 0000000000000000\n[    4.771709] R10: ffff9e5400073b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.778843] R13: ffff966ec6fb4fe0 R14: ffff9e5400073c60 R15: 0000000000000001\n[    4.785978] FS:  0000000000000000(0000) GS:ffff966eeae00000(0000) knlGS:0000000000000000\n[    4.794068] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.799819] CR2: ffff966eef1ff000 CR3: 00000000b2e28000 CR4: 00000000003506f0\n[    4.806956] Call Trace:\n[    4.809412]  <TASK>\n[    4.811519]  ? __warn+0x85/0x130\n[    4.814758]  ? __flush_work+0x29f/0x2c0\n[    4.818599]  ? report_bug+0x160/0x190\n[    4.822271]  ? handle_bug+0x53/0x90\n[    4.825769]  ? exc_invalid_op+0x13/0x60\n[    4.829610]  ? asm_exc_invalid_op+0x16/0x20\n[    4.833800]  ? __flush_work+0x29f/0x2c0\n[    4.837644]  cancel_delayed_work_sync+0x6e/0x90\n[    4.842179]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.846717]  amdgpu_ring_alloc+0x3f/0x60\n[    4.850649]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.854757]  amdgpu_job_submit_direct+0x30/0x50\n[    4.859295]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.864267]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.868629]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    4.874468]  process_one_work+0x18b/0x3d0\n[    4.878485]  worker_thread+0x2e4/0x420\n[    4.882245]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    4.887134]  ? rescuer_thread+0x5d0/0x5d0\n[    4.891150]  kthread+0xdf/0x110\n[    4.894300]  ? kthread_park+0x90/0x90\n[    4.897969]  ret_from_fork+0x30/0x50\n[    4.901549]  ? kthread_park+0x90/0x90\n[    4.905218]  ret_from_fork_asm+0x11/0x20\n[    4.909153]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d15127eb0fe8e585494f509015a2cdbab02a49b0', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df511fb139cb87dffb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d15127eb0fe8e585494f509015a2cdbab02a49b0', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df511fb139cb87dffb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:50:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.233843] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.241762] Modules linked in:\n[    4.244825] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.256117] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.265243] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.269691] Code: 48 8b 15 c4 43 10 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.288443] RSP: 0018:ffff9e5400033b60 EFLAGS: 00010246\n[    4.293672] RAX: 0000000000000000 RBX: ffff966ec6fbbd08 RCX: 0000000000000000\n[    4.300803] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9e5400033bc0\n[    4.307934] RBP: ffff966ec6fbbd08 R08: ffff966ec6fb1fa0 R09: ffff966ec1c30000\n[    4.315064] R10: 0000000000000040 R11: ffffffffa352fd88 R12: ffff966ec6f80000\n[    4.322201] R13: ffff966ec6fb4fe0 R14: ffff9e5400033b68 R15: 0000000000000001\n[    4.329332] FS:  0000000000000000(0000) GS:ffff966eeaf00000(0000) knlGS:0000000000000000\n[    4.337421] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.343166] CR2: 0000000000000000 CR3: 00000000b2e28000 CR4: 00000000003506f0\n[    4.350298] Call Trace:\n[    4.352751]  <TASK>\n[    4.354856]  ? __warn+0x85/0x130\n[    4.358088]  ? __flush_work+0x29f/0x2c0\n[    4.361929]  ? report_bug+0x160/0x190\n[    4.365598]  ? handle_bug+0x53/0x90\n[    4.369093]  ? exc_invalid_op+0x13/0x60\n[    4.372933]  ? asm_exc_invalid_op+0x16/0x20\n[    4.377126]  ? __flush_work+0x29f/0x2c0\n[    4.380971]  cancel_delayed_work_sync+0x6e/0x90\n[    4.385503]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.390037]  amdgpu_ring_alloc+0x3f/0x60\n[    4.393968]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.399109]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.403557]  amdgpu_device_init+0x205f/0x26f0\n[    4.407918]  amdgpu_driver_load_kms+0x15/0x80\n[    4.412276]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.416291]  pci_device_probe+0x98/0x120\n[    4.420220]  really_probe+0xd1/0x2b0\n[    4.423804]  ? __device_attach_driver+0xc0/0xc0\n[    4.428335]  __driver_probe_device+0x73/0x120\n[    4.432694]  driver_probe_device+0x1f/0x90\n[    4.436795]  __driver_attach+0x84/0x130\n[    4.440635]  bus_for_each_dev+0x84/0xd0\n[    4.444476]  bus_add_driver+0xe4/0x210\n[    4.448231]  driver_register+0x55/0x100\n[    4.452069]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.456865]  do_one_initcall+0x57/0x300\n[    4.460707]  kernel_init_freeable+0x1be/0x300\n[    4.465071]  ? rest_init+0xc0/0xc0\n[    4.468479]  kernel_init+0x16/0x1b0\n[    4.471972]  ret_from_fork+0x30/0x50\n[    4.475555]  ? rest_init+0xc0/0xc0\n[    4.478959]  ret_from_fork_asm+0x11/0x20\n[    4.482890]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.679383] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.687306] Modules linked in:\n[    4.690370] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.703316] Tainted: [W]=WARN\n[    4.706286] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.715415] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.721864] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.726317] Code: 48 8b 15 c4 43 10 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.745069] RSP: 0018:ffff9e5400073c58 EFLAGS: 00010246\n[    4.750301] RAX: 0000000000000000 RBX: ffff966ec6fbbd08 RCX: 0000000000000000\n[    4.757439] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9e5400073cb8\n[    4.764574] RBP: ffff966ec6fbbd08 R08: ffff9e5400073de8 R09: 0000000000000000\n[    4.771709] R10: ffff9e5400073b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.778843] R13: ffff966ec6fb4fe0 R14: ffff9e5400073c60 R15: 0000000000000001\n[    4.785978] FS:  0000000000000000(0000) GS:ffff966eeae00000(0000) knlGS:0000000000000000\n[    4.794068] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.799819] CR2: ffff966eef1ff000 CR3: 00000000b2e28000 CR4: 00000000003506f0\n[    4.806956] Call Trace:\n[    4.809412]  <TASK>\n[    4.811519]  ? __warn+0x85/0x130\n[    4.814758]  ? __flush_work+0x29f/0x2c0\n[    4.818599]  ? report_bug+0x160/0x190\n[    4.822271]  ? handle_bug+0x53/0x90\n[    4.825769]  ? exc_invalid_op+0x13/0x60\n[    4.829610]  ? asm_exc_invalid_op+0x16/0x20\n[    4.833800]  ? __flush_work+0x29f/0x2c0\n[    4.837644]  cancel_delayed_work_sync+0x6e/0x90\n[    4.842179]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.846717]  amdgpu_ring_alloc+0x3f/0x60\n[    4.850649]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.854757]  amdgpu_job_submit_direct+0x30/0x50\n[    4.859295]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.864267]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.868629]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    4.874468]  process_one_work+0x18b/0x3d0\n[    4.878485]  worker_thread+0x2e4/0x420\n[    4.882245]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    4.887134]  ? rescuer_thread+0x5d0/0x5d0\n[    4.891150]  kthread+0xdf/0x110\n[    4.894300]  ? kthread_park+0x90/0x90\n[    4.897969]  ret_from_fork+0x30/0x50\n[    4.901549]  ? kthread_park+0x90/0x90\n[    4.905218]  ret_from_fork_asm+0x11/0x20\n[    4.909153]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f168768adf4878b0df747580665e25eddf184248', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406eb511fb139cb87e176a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f168768adf4878b0df747580665e25eddf184248', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406eb511fb139cb87e176a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df511fb139cb87dffb3
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e176a
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e176b
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb511fb139cb87e176c
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d15127eb0fe8e585494f509015a2cdbab02a49b0
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d15127eb0fe8e585494f509015a2cdbab02a49b0
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f168768adf4878b0df747580665e25eddf184248
11/22/2024 12:50:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f168768adf4878b0df747580665e25eddf184248
11/22/2024 12:50:46 PM UTC [INFO] Received an event for node: 67406df311fb139cb87dff9d
11/22/2024 12:50:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.565692] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.573613] Modules linked in:\n[    4.576675] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.587969] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.597439] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.601887] Code: 48 8b 15 c4 43 90 6e 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.620634] RSP: 0018:ffffa0e6c0033b60 EFLAGS: 00010246\n[    4.625861] RAX: 0000000000000000 RBX: ffff9bc1876bbd08 RCX: 0000000000000000\n[    4.632992] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa0e6c0033bc0\n[    4.640124] RBP: ffff9bc1876bbd08 R08: ffff9bc1876b1fa0 R09: ffff9bc1822f9000\n[    4.647255] R10: 0000000000000040 R11: ffffffff94d2fd88 R12: ffff9bc187680000\n[    4.654387] R13: ffff9bc1876b4fe0 R14: ffffa0e6c0033b68 R15: 0000000000000001\n[    4.661519] FS:  0000000000000000(0000) GS:ffff9bc2a7100000(0000) knlGS:0000000000000000\n[    4.669601] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.675348] CR2: 0000000000000000 CR3: 0000000153a28000 CR4: 00000000003506f0\n[    4.682479] Call Trace:\n[    4.684929]  <TASK>\n[    4.687034]  ? __warn+0x85/0x130\n[    4.690269]  ? __flush_work+0x29f/0x2c0\n[    4.694107]  ? report_bug+0x160/0x190\n[    4.697777]  ? handle_bug+0x53/0x90\n[    4.701272]  ? exc_invalid_op+0x13/0x60\n[    4.705112]  ? asm_exc_invalid_op+0x16/0x20\n[    4.709303]  ? __flush_work+0x29f/0x2c0\n[    4.713146]  cancel_delayed_work_sync+0x6e/0x90\n[    4.717681]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.722218]  amdgpu_ring_alloc+0x3f/0x60\n[    4.726146]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.731286]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.735733]  amdgpu_device_init+0x205f/0x26f0\n[    4.740095]  amdgpu_driver_load_kms+0x15/0x80\n[    4.744454]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.748469]  pci_device_probe+0x98/0x120\n[    4.752398]  really_probe+0xd1/0x2b0\n[    4.755979]  ? __device_attach_driver+0xc0/0xc0\n[    4.760513]  __driver_probe_device+0x73/0x120\n[    4.764873]  driver_probe_device+0x1f/0x90\n[    4.768974]  __driver_attach+0x84/0x130\n[    4.772813]  bus_for_each_dev+0x84/0xd0\n[    4.776654]  bus_add_driver+0xe4/0x210\n[    4.780409]  driver_register+0x55/0x100\n[    4.784248]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.789042]  do_one_initcall+0x57/0x300\n[    4.792884]  kernel_init_freeable+0x1be/0x300\n[    4.797248]  ? rest_init+0xc0/0xc0\n[    4.800653]  kernel_init+0x16/0x1b0\n[    4.804147]  ret_from_fork+0x30/0x50\n[    4.807727]  ? rest_init+0xc0/0xc0\n[    4.811132]  ret_from_fork_asm+0x11/0x20\n[    4.815063]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.011657] WARNING: CPU: 2 PID: 58 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.019668] Modules linked in:\n[    5.022726] CPU: 2 UID: 0 PID: 58 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.035759] Tainted: [W]=WARN\n[    5.038731] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.048206] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.054657] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.059109] Code: 48 8b 15 c4 43 90 6e 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.077861] RSP: 0018:ffffa0e6c02a3c58 EFLAGS: 00010246\n[    5.083092] RAX: 0000000000000000 RBX: ffff9bc1876bbd08 RCX: 0000000000000000\n[    5.090227] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa0e6c02a3cb8\n[    5.097362] RBP: ffff9bc1876bbd08 R08: ffffa0e6c02a3de8 R09: 0000000000000000\n[    5.104497] R10: ffffa0e6c02a3b30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.111632] R13: ffff9bc1876b4fe0 R14: ffffa0e6c02a3c60 R15: 0000000000000001\n[    5.118767] FS:  0000000000000000(0000) GS:ffff9bc2a7100000(0000) knlGS:0000000000000000\n[    5.126854] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.132606] CR2: 0000000000000000 CR3: 0000000153a28000 CR4: 00000000003506f0\n[    5.139741] Call Trace:\n[    5.142193]  <TASK>\n[    5.144301]  ? __warn+0x85/0x130\n[    5.147536]  ? __flush_work+0x29f/0x2c0\n[    5.151382]  ? report_bug+0x160/0x190\n[    5.155056]  ? handle_bug+0x53/0x90\n[    5.158554]  ? exc_invalid_op+0x13/0x60\n[    5.162395]  ? asm_exc_invalid_op+0x16/0x20\n[    5.166592]  ? __flush_work+0x29f/0x2c0\n[    5.170443]  cancel_delayed_work_sync+0x6e/0x90\n[    5.174983]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.179523]  amdgpu_ring_alloc+0x3f/0x60\n[    5.183457]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.187564]  amdgpu_job_submit_direct+0x30/0x50\n[    5.192104]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.197077]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.201443]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.207282]  process_one_work+0x18b/0x3d0\n[    5.211301]  worker_thread+0x2e4/0x420\n[    5.215060]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.219944]  ? rescuer_thread+0x5d0/0x5d0\n[    5.223961]  kthread+0xdf/0x110\n[    5.227107]  ? kthread_park+0x90/0x90\n[    5.230777]  ret_from_fork+0x30/0x50\n[    5.234361]  ? kthread_park+0x90/0x90\n[    5.238031]  ret_from_fork_asm+0x11/0x20\n[    5.241964]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8ddaf979877b5cb0456afa668a0aec0b4b41add7', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df311fb139cb87dff9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8ddaf979877b5cb0456afa668a0aec0b4b41add7', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df311fb139cb87dff9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:50:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.565692] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.573613] Modules linked in:\n[    4.576675] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.587969] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.597439] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.601887] Code: 48 8b 15 c4 43 90 6e 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.620634] RSP: 0018:ffffa0e6c0033b60 EFLAGS: 00010246\n[    4.625861] RAX: 0000000000000000 RBX: ffff9bc1876bbd08 RCX: 0000000000000000\n[    4.632992] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa0e6c0033bc0\n[    4.640124] RBP: ffff9bc1876bbd08 R08: ffff9bc1876b1fa0 R09: ffff9bc1822f9000\n[    4.647255] R10: 0000000000000040 R11: ffffffff94d2fd88 R12: ffff9bc187680000\n[    4.654387] R13: ffff9bc1876b4fe0 R14: ffffa0e6c0033b68 R15: 0000000000000001\n[    4.661519] FS:  0000000000000000(0000) GS:ffff9bc2a7100000(0000) knlGS:0000000000000000\n[    4.669601] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.675348] CR2: 0000000000000000 CR3: 0000000153a28000 CR4: 00000000003506f0\n[    4.682479] Call Trace:\n[    4.684929]  <TASK>\n[    4.687034]  ? __warn+0x85/0x130\n[    4.690269]  ? __flush_work+0x29f/0x2c0\n[    4.694107]  ? report_bug+0x160/0x190\n[    4.697777]  ? handle_bug+0x53/0x90\n[    4.701272]  ? exc_invalid_op+0x13/0x60\n[    4.705112]  ? asm_exc_invalid_op+0x16/0x20\n[    4.709303]  ? __flush_work+0x29f/0x2c0\n[    4.713146]  cancel_delayed_work_sync+0x6e/0x90\n[    4.717681]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.722218]  amdgpu_ring_alloc+0x3f/0x60\n[    4.726146]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.731286]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.735733]  amdgpu_device_init+0x205f/0x26f0\n[    4.740095]  amdgpu_driver_load_kms+0x15/0x80\n[    4.744454]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.748469]  pci_device_probe+0x98/0x120\n[    4.752398]  really_probe+0xd1/0x2b0\n[    4.755979]  ? __device_attach_driver+0xc0/0xc0\n[    4.760513]  __driver_probe_device+0x73/0x120\n[    4.764873]  driver_probe_device+0x1f/0x90\n[    4.768974]  __driver_attach+0x84/0x130\n[    4.772813]  bus_for_each_dev+0x84/0xd0\n[    4.776654]  bus_add_driver+0xe4/0x210\n[    4.780409]  driver_register+0x55/0x100\n[    4.784248]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.789042]  do_one_initcall+0x57/0x300\n[    4.792884]  kernel_init_freeable+0x1be/0x300\n[    4.797248]  ? rest_init+0xc0/0xc0\n[    4.800653]  kernel_init+0x16/0x1b0\n[    4.804147]  ret_from_fork+0x30/0x50\n[    4.807727]  ? rest_init+0xc0/0xc0\n[    4.811132]  ret_from_fork_asm+0x11/0x20\n[    4.815063]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.011657] WARNING: CPU: 2 PID: 58 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.019668] Modules linked in:\n[    5.022726] CPU: 2 UID: 0 PID: 58 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.035759] Tainted: [W]=WARN\n[    5.038731] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.048206] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.054657] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.059109] Code: 48 8b 15 c4 43 90 6e 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.077861] RSP: 0018:ffffa0e6c02a3c58 EFLAGS: 00010246\n[    5.083092] RAX: 0000000000000000 RBX: ffff9bc1876bbd08 RCX: 0000000000000000\n[    5.090227] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa0e6c02a3cb8\n[    5.097362] RBP: ffff9bc1876bbd08 R08: ffffa0e6c02a3de8 R09: 0000000000000000\n[    5.104497] R10: ffffa0e6c02a3b30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.111632] R13: ffff9bc1876b4fe0 R14: ffffa0e6c02a3c60 R15: 0000000000000001\n[    5.118767] FS:  0000000000000000(0000) GS:ffff9bc2a7100000(0000) knlGS:0000000000000000\n[    5.126854] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.132606] CR2: 0000000000000000 CR3: 0000000153a28000 CR4: 00000000003506f0\n[    5.139741] Call Trace:\n[    5.142193]  <TASK>\n[    5.144301]  ? __warn+0x85/0x130\n[    5.147536]  ? __flush_work+0x29f/0x2c0\n[    5.151382]  ? report_bug+0x160/0x190\n[    5.155056]  ? handle_bug+0x53/0x90\n[    5.158554]  ? exc_invalid_op+0x13/0x60\n[    5.162395]  ? asm_exc_invalid_op+0x16/0x20\n[    5.166592]  ? __flush_work+0x29f/0x2c0\n[    5.170443]  cancel_delayed_work_sync+0x6e/0x90\n[    5.174983]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.179523]  amdgpu_ring_alloc+0x3f/0x60\n[    5.183457]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.187564]  amdgpu_job_submit_direct+0x30/0x50\n[    5.192104]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.197077]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.201443]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.207282]  process_one_work+0x18b/0x3d0\n[    5.211301]  worker_thread+0x2e4/0x420\n[    5.215060]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.219944]  ? rescuer_thread+0x5d0/0x5d0\n[    5.223961]  kthread+0xdf/0x110\n[    5.227107]  ? kthread_park+0x90/0x90\n[    5.230777]  ret_from_fork+0x30/0x50\n[    5.234361]  ? kthread_park+0x90/0x90\n[    5.238031]  ret_from_fork_asm+0x11/0x20\n[    5.241964]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:542c33585f5d1ac4b3a83407e5d79c5c34e37f9e', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406eb911fb139cb87e1772', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:542c33585f5d1ac4b3a83407e5d79c5c34e37f9e', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406eb911fb139cb87e1772', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df311fb139cb87dff9d
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb911fb139cb87e1772
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb911fb139cb87e1773
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eb911fb139cb87e1774
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ddaf979877b5cb0456afa668a0aec0b4b41add7
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ddaf979877b5cb0456afa668a0aec0b4b41add7
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:542c33585f5d1ac4b3a83407e5d79c5c34e37f9e
11/22/2024 12:50:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:542c33585f5d1ac4b3a83407e5d79c5c34e37f9e
11/22/2024 12:50:49 PM UTC [INFO] Received an event for node: 67406d1011fb139cb87dfab4
11/22/2024 12:52:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1011fb139cb87dfab4
11/22/2024 12:52:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1783
11/22/2024 12:52:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1784
11/22/2024 12:52:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1785
11/22/2024 12:52:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1786
11/22/2024 12:52:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1787
11/22/2024 12:52:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1788
11/22/2024 12:52:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1789
11/22/2024 12:52:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178a
11/22/2024 12:52:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178b
11/22/2024 12:52:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178c
11/22/2024 12:52:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178d
11/22/2024 12:52:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178e
11/22/2024 12:52:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e178f
11/22/2024 12:52:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1790
11/22/2024 12:52:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1791
11/22/2024 12:52:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1792
11/22/2024 12:52:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1793
11/22/2024 12:52:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1794
11/22/2024 12:52:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1795
11/22/2024 12:52:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1796
11/22/2024 12:52:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1797
11/22/2024 12:52:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1798
11/22/2024 12:52:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1799
11/22/2024 12:52:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179a
11/22/2024 12:52:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179b
11/22/2024 12:52:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179c
11/22/2024 12:52:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179d
11/22/2024 12:52:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179e
11/22/2024 12:52:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e179f
11/22/2024 12:52:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a0
11/22/2024 12:52:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a1
11/22/2024 12:52:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a2
11/22/2024 12:52:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a3
11/22/2024 12:52:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a4
11/22/2024 12:52:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a5
11/22/2024 12:52:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a6
11/22/2024 12:52:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a7
11/22/2024 12:52:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a8
11/22/2024 12:52:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17a9
11/22/2024 12:52:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17aa
11/22/2024 12:52:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ab
11/22/2024 12:52:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ac
11/22/2024 12:52:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ad
11/22/2024 12:52:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ae
11/22/2024 12:52:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17af
11/22/2024 12:52:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b0
11/22/2024 12:52:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b1
11/22/2024 12:52:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b2
11/22/2024 12:52:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b3
11/22/2024 12:52:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b4
11/22/2024 12:52:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b5
11/22/2024 12:52:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b6
11/22/2024 12:52:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b7
11/22/2024 12:52:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b8
11/22/2024 12:52:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17b9
11/22/2024 12:53:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ba
11/22/2024 12:53:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17bb
11/22/2024 12:53:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17bc
11/22/2024 12:53:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17bd
11/22/2024 12:53:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17be
11/22/2024 12:53:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17bf
11/22/2024 12:53:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c0
11/22/2024 12:53:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c1
11/22/2024 12:53:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c2
11/22/2024 12:53:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c3
11/22/2024 12:53:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c4
11/22/2024 12:53:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c5
11/22/2024 12:53:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c6
11/22/2024 12:53:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c7
11/22/2024 12:53:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c8
11/22/2024 12:53:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17c9
11/22/2024 12:53:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ca
11/22/2024 12:53:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17cb
11/22/2024 12:53:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17cc
11/22/2024 12:53:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17cd
11/22/2024 12:53:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ce
11/22/2024 12:53:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17cf
11/22/2024 12:53:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d0
11/22/2024 12:53:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d1
11/22/2024 12:53:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d2
11/22/2024 12:53:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d3
11/22/2024 12:53:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d4
11/22/2024 12:53:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d5
11/22/2024 12:53:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d6
11/22/2024 12:53:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d7
11/22/2024 12:53:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d8
11/22/2024 12:53:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17d9
11/22/2024 12:53:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17da
11/22/2024 12:53:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17db
11/22/2024 12:53:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17dc
11/22/2024 12:53:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17dd
11/22/2024 12:53:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17de
11/22/2024 12:53:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17df
11/22/2024 12:53:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e0
11/22/2024 12:53:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e1
11/22/2024 12:53:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e2
11/22/2024 12:53:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e3
11/22/2024 12:53:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e4
11/22/2024 12:53:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e5
11/22/2024 12:53:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e6
11/22/2024 12:53:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e7
11/22/2024 12:53:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e8
11/22/2024 12:53:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17e9
11/22/2024 12:53:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ea
11/22/2024 12:53:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17eb
11/22/2024 12:53:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ec
11/22/2024 12:53:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ed
11/22/2024 12:53:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ee
11/22/2024 12:53:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ef
11/22/2024 12:53:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f0
11/22/2024 12:53:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f1
11/22/2024 12:53:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f2
11/22/2024 12:53:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f3
11/22/2024 12:53:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f4
11/22/2024 12:53:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f5
11/22/2024 12:53:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f6
11/22/2024 12:53:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f7
11/22/2024 12:53:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f8
11/22/2024 12:53:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17f9
11/22/2024 12:53:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17fa
11/22/2024 12:53:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17fb
11/22/2024 12:53:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17fc
11/22/2024 12:53:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17fd
11/22/2024 12:53:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17fe
11/22/2024 12:53:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e17ff
11/22/2024 12:53:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1800
11/22/2024 12:53:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1801
11/22/2024 12:53:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1802
11/22/2024 12:53:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1803
11/22/2024 12:53:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1804
11/22/2024 12:53:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1805
11/22/2024 12:53:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1806
11/22/2024 12:53:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1807
11/22/2024 12:53:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1808
11/22/2024 12:53:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1809
11/22/2024 12:53:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180a
11/22/2024 12:53:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180b
11/22/2024 12:53:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180c
11/22/2024 12:53:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180d
11/22/2024 12:53:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180e
11/22/2024 12:53:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e180f
11/22/2024 12:53:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1810
11/22/2024 12:53:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1811
11/22/2024 12:53:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1812
11/22/2024 12:53:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1813
11/22/2024 12:53:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1814
11/22/2024 12:53:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1815
11/22/2024 12:53:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1816
11/22/2024 12:53:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1817
11/22/2024 12:53:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1818
11/22/2024 12:53:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1819
11/22/2024 12:53:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181a
11/22/2024 12:53:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181b
11/22/2024 12:53:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181c
11/22/2024 12:53:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181d
11/22/2024 12:53:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181e
11/22/2024 12:53:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e181f
11/22/2024 12:53:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1820
11/22/2024 12:53:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1821
11/22/2024 12:53:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1822
11/22/2024 12:53:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1823
11/22/2024 12:53:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1824
11/22/2024 12:53:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1825
11/22/2024 12:53:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1826
11/22/2024 12:53:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1827
11/22/2024 12:53:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1828
11/22/2024 12:53:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1829
11/22/2024 12:53:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182a
11/22/2024 12:53:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182b
11/22/2024 12:53:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182c
11/22/2024 12:53:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182d
11/22/2024 12:53:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182e
11/22/2024 12:53:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e182f
11/22/2024 12:53:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1830
11/22/2024 12:53:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1831
11/22/2024 12:53:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1832
11/22/2024 12:53:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1833
11/22/2024 12:53:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1834
11/22/2024 12:53:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1835
11/22/2024 12:53:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1836
11/22/2024 12:53:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1837
11/22/2024 12:53:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1838
11/22/2024 12:53:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1839
11/22/2024 12:53:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183a
11/22/2024 12:53:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183b
11/22/2024 12:53:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183c
11/22/2024 12:53:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183d
11/22/2024 12:53:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183e
11/22/2024 12:53:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e183f
11/22/2024 12:53:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1840
11/22/2024 12:53:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1841
11/22/2024 12:53:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1842
11/22/2024 12:53:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1843
11/22/2024 12:53:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1844
11/22/2024 12:53:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1845
11/22/2024 12:53:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1846
11/22/2024 12:53:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1847
11/22/2024 12:53:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1848
11/22/2024 12:53:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1849
11/22/2024 12:53:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184a
11/22/2024 12:53:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184b
11/22/2024 12:53:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184c
11/22/2024 12:53:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184d
11/22/2024 12:53:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184e
11/22/2024 12:53:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e184f
11/22/2024 12:53:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1850
11/22/2024 12:53:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1851
11/22/2024 12:53:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1852
11/22/2024 12:53:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1853
11/22/2024 12:53:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1854
11/22/2024 12:53:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1855
11/22/2024 12:53:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1856
11/22/2024 12:53:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1857
11/22/2024 12:53:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1858
11/22/2024 12:53:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e1859
11/22/2024 12:53:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e185a
11/22/2024 12:53:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e185b
11/22/2024 12:53:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406eba11fb139cb87e185c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1011fb139cb87dfab4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e177f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1780
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1781
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1782
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1783
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1784
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1785
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1786
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1787
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1788
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1789
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e178f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1790
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1791
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1792
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1793
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1794
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1795
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1796
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1797
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1798
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1799
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e179f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17a9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17aa
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ab
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ac
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ad
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ae
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17af
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17b9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ba
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17bb
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17bc
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17bd
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17be
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17bf
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17c9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ca
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17cb
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17cc
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17cd
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ce
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17cf
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17d9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17da
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17db
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17dc
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17dd
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17de
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17df
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17e9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ea
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17eb
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ec
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ed
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ee
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ef
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f0
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f1
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f2
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f3
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f4
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f5
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f6
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f7
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f8
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17f9
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17fa
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17fb
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17fc
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17fd
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17fe
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e17ff
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1800
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1801
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1802
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1803
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1804
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1805
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1806
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1807
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1808
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1809
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e180f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1810
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1811
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1812
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1813
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1814
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1815
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1816
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1817
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1818
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1819
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e181f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1820
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1821
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1822
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1823
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1824
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1825
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1826
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1827
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1828
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1829
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e182f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1830
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1831
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1832
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1833
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1834
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1835
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1836
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1837
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1838
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1839
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e183f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1840
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1841
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1842
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1843
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1844
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1845
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1846
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1847
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1848
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1849
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184d
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184e
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e184f
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1850
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1851
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1852
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1853
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1854
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1855
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1856
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1857
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1858
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1859
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e185a
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e185b
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e185c
11/22/2024 12:53:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e185d
11/22/2024 12:53:52 PM UTC [INFO] Received an event for node: 67406e1711fb139cb87e016a
11/22/2024 12:53:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e016a
11/22/2024 12:53:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1863
11/22/2024 12:53:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1864
11/22/2024 12:53:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eba11fb139cb87e1865
11/22/2024 12:53:55 PM UTC [INFO] Received an event for node: 67406d1911fb139cb87dfaed
11/22/2024 12:53:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1911fb139cb87dfaed
11/22/2024 12:53:57 PM UTC [INFO] Received an event for node: 67406d1511fb139cb87dfad2
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1511fb139cb87dfad2
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e186f
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e1870
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e1871
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e1872
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e1873
11/22/2024 12:54:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebd11fb139cb87e1874
11/22/2024 12:54:01 PM UTC [INFO] Received an event for node: 67406d1311fb139cb87dfac6
11/22/2024 12:54:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1311fb139cb87dfac6
11/22/2024 12:54:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e195b
11/22/2024 12:54:03 PM UTC [INFO] Received an event for node: 67406d1211fb139cb87dfabd
11/22/2024 12:55:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5fc4255bcf1ea95396d4c44cf08968dbabdbb55a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1211fb139cb87dfabd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5fc4255bcf1ea95396d4c44cf08968dbabdbb55a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1211fb139cb87dfabd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efe0c6fe2eba2b64e7d9bce35176d7cde7c9cff8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1883', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:efe0c6fe2eba2b64e7d9bce35176d7cde7c9cff8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1883', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9cb50a08e16014a167fe5accaedeb28641cb983a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1884', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9cb50a08e16014a167fe5accaedeb28641cb983a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1884', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d69d078902976d0c7c79f58bb6b8e3b1a9abbb08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1885', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d69d078902976d0c7c79f58bb6b8e3b1a9abbb08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1885', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:856ab577f068af6a2e4d00f7fd4b5155b3756120', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1886', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:856ab577f068af6a2e4d00f7fd4b5155b3756120', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1886', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:838aff77d3e6616d90d5ecdee1275fb4ec76ea27', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1887', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:838aff77d3e6616d90d5ecdee1275fb4ec76ea27', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1887', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2ccf52975e27ebf28925fc7caa1169a0408d40e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1888', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2ccf52975e27ebf28925fc7caa1169a0408d40e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1888', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:53cb8d7c06617fa51e78f0fe91221c49a3100c2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1889', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:53cb8d7c06617fa51e78f0fe91221c49a3100c2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1889', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:231f3d67b7d1042d0df051a0ceb462007221ba81', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:231f3d67b7d1042d0df051a0ceb462007221ba81', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:06e8bbfa3c716f694237235080a9f7bc86a1d99b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:06e8bbfa3c716f694237235080a9f7bc86a1d99b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6449ae1a94e40d5fa8b04abc69d2503d96bdee0d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6449ae1a94e40d5fa8b04abc69d2503d96bdee0d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:91b911ec7418b27546f553089193a112a440f2ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:91b911ec7418b27546f553089193a112a440f2ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ab7655d2de284dcf41af1cc1174247cf1e60194b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab7655d2de284dcf41af1cc1174247cf1e60194b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6b5dbcf0ea52ead193708baf9e0c12d2f7bf37d6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6b5dbcf0ea52ead193708baf9e0c12d2f7bf37d6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e188f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2ffb4334e6f7bbf5eebf9776189745caf06f3df6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1890', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2ffb4334e6f7bbf5eebf9776189745caf06f3df6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1890', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e083b94d5afa050f58649fcfe90eb27f267a341b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1891', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e083b94d5afa050f58649fcfe90eb27f267a341b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1891', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2954231d8ff6c52b44fc89061754d1f82e2b23bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1892', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2954231d8ff6c52b44fc89061754d1f82e2b23bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1892', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ca83712b1bf5c29fbd1a0aad1205db847fda5ee6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1893', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca83712b1bf5c29fbd1a0aad1205db847fda5ee6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1893', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc9d2048223ed288336cc908ee8c8b505dc9491d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1894', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc9d2048223ed288336cc908ee8c8b505dc9491d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1894', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7efd7ea4571d6dcb53bc677bdd6f153f3edce7ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1895', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7efd7ea4571d6dcb53bc677bdd6f153f3edce7ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1895', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b40f9fd5d658cf7a991e9b696a203a0dd54b89e1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1896', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b40f9fd5d658cf7a991e9b696a203a0dd54b89e1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1896', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:98eee9f41ed0e610a0787e7adc710cfda9b125a4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1897', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:98eee9f41ed0e610a0787e7adc710cfda9b125a4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1897', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e254d8aef4990ebdaca0a0558d99d6f8bd19ac84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1898', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e254d8aef4990ebdaca0a0558d99d6f8bd19ac84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1898', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:62e3d377747c6580556f8866fb725ec09bc30b2a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1899', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:62e3d377747c6580556f8866fb725ec09bc30b2a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1899', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:55:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8c3c71cee0cb890ec23d7c2669e8ba55005823d8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8c3c71cee0cb890ec23d7c2669e8ba55005823d8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d3cf31287b42d1d429edebb60ad4d61ca180c523', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d3cf31287b42d1d429edebb60ad4d61ca180c523', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a69e745fec0448e6c18300d8082de5cd7eaa5078', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a69e745fec0448e6c18300d8082de5cd7eaa5078', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:31e04756b0f487804a8008b61e550ad0c042a207', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31e04756b0f487804a8008b61e550ad0c042a207', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a958e1d65fe10b677f0adf6405208c44ffddafa9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a958e1d65fe10b677f0adf6405208c44ffddafa9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:be0b624243772b5db88f6c565e266caf39e838b4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be0b624243772b5db88f6c565e266caf39e838b4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e189f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ec20765fb045093775f52b70a53b7d9f74609e22', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ec20765fb045093775f52b70a53b7d9f74609e22', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:18c66f7fd52b3060c97e6750c88d6010db4a303e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18c66f7fd52b3060c97e6750c88d6010db4a303e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:778cc285a266bf4dbcbf172012a12fde6c30dde9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:778cc285a266bf4dbcbf172012a12fde6c30dde9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:64c17cf0fac5260dccdd4063a43f2b99afeb606c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64c17cf0fac5260dccdd4063a43f2b99afeb606c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ee8cf8d82f609b24624a1c5cc04665fe5d7c05ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee8cf8d82f609b24624a1c5cc04665fe5d7c05ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:34abd95cabb0c49f18116930aaa96518e4ecbf9f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34abd95cabb0c49f18116930aaa96518e4ecbf9f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:64c23b9c67e1ce1de825b52afa4d61344bd45c6a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64c23b9c67e1ce1de825b52afa4d61344bd45c6a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d91cc6ab74a4a91305e228befecd9ff88c3cdc4e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d91cc6ab74a4a91305e228befecd9ff88c3cdc4e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0551a7567405fef5d0ee1a88105e84ce97d4dabc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0551a7567405fef5d0ee1a88105e84ce97d4dabc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:75078e9fe4285997737662706f6e7dea18897d78', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:75078e9fe4285997737662706f6e7dea18897d78', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0f8559c1ff56eabe31987489f35bda09741188b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0f8559c1ff56eabe31987489f35bda09741188b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b9eaee70e2767ac3b0a03c083736e51de332214b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b9eaee70e2767ac3b0a03c083736e51de332214b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4c86c2d793dec5747dadfcb48c3aae64ed98dbe4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c86c2d793dec5747dadfcb48c3aae64ed98dbe4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1403475f77abe7b75901705f973a477c00036384', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1403475f77abe7b75901705f973a477c00036384', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4a3bb869891c29be27efd1f6793ad511baf4a4fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a3bb869891c29be27efd1f6793ad511baf4a4fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:70d1bf40203d3562674e9fb8fb2ff6a666750113', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:70d1bf40203d3562674e9fb8fb2ff6a666750113', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b57f6c1243f56a6d23a3df12ef5eac5a27d47b1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b57f6c1243f56a6d23a3df12ef5eac5a27d47b1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6f09d24fbfd62b6fc94e803b12de9a74a0f7eab6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6f09d24fbfd62b6fc94e803b12de9a74a0f7eab6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1a2635e876bdfcb22cb8492c59f4ef117a09fb8b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a2635e876bdfcb22cb8492c59f4ef117a09fb8b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cbbaea6aa5862a41005ed189b5b839a01a1e797b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cbbaea6aa5862a41005ed189b5b839a01a1e797b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8326a2fb6ccd24680a0d445f02eb2a1f8091f348', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8326a2fb6ccd24680a0d445f02eb2a1f8091f348', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e2ea4c2914ea551a97c8d1033f43b01f7f780189', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e2ea4c2914ea551a97c8d1033f43b01f7f780189', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:88d16b90bbdb57a7367dae6a7857116a8e47faf0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:88d16b90bbdb57a7367dae6a7857116a8e47faf0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:47449fefd139c3b3746316fafe8e93cbcb188426', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47449fefd139c3b3746316fafe8e93cbcb188426', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d82a70e339ec3a6fe2f9ed9b07e8f89a50be5a46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d82a70e339ec3a6fe2f9ed9b07e8f89a50be5a46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1c6e2406f44ac52c4be3544c40578d711f805864', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1c6e2406f44ac52c4be3544c40578d711f805864', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:de0c102f80edf0a3ea6b95d629ebae56fdf5dd69', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de0c102f80edf0a3ea6b95d629ebae56fdf5dd69', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:92100ce710cbb5cb4eb109ce1be7f64843ed4ef4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:92100ce710cbb5cb4eb109ce1be7f64843ed4ef4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:39e56a1822ced3b7361761a80352707afa199dd0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:39e56a1822ced3b7361761a80352707afa199dd0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a93aeb6f130b550974a862deaa9d561c3faea0b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a93aeb6f130b550974a862deaa9d561c3faea0b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:56596bc782cca258142ce7c0990e3d9dfe995c56', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:56596bc782cca258142ce7c0990e3d9dfe995c56', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:39e4b67ce3055690b25a0ad4714592a9fafed6c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:39e4b67ce3055690b25a0ad4714592a9fafed6c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1b05622d88039d5ae589ea1367d2237771e22620', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1b05622d88039d5ae589ea1367d2237771e22620', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f52094a0d218815333224886e5f208f3ca87e7d7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f52094a0d218815333224886e5f208f3ca87e7d7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f766d1e0f1468b836d29aa7750f6eb135c528518', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f766d1e0f1468b836d29aa7750f6eb135c528518', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ec4d45e345b5adb82288d3ecdfa5a018f8448d3b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ec4d45e345b5adb82288d3ecdfa5a018f8448d3b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d700b16ce497479e1f391ddeb942bbdff147b57c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d700b16ce497479e1f391ddeb942bbdff147b57c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1963bd9ad92b3b88f964686cd114488b5a0ef582', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1963bd9ad92b3b88f964686cd114488b5a0ef582', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a35113f9d3e0c800269eac77c46a74b272206cdc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a35113f9d3e0c800269eac77c46a74b272206cdc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c6f56b70fe2f935e4404ed07857fedcefd3a3cd9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c6f56b70fe2f935e4404ed07857fedcefd3a3cd9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2401c88f65590757ced3599f5a6bf601305d19f8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2401c88f65590757ced3599f5a6bf601305d19f8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b87ac1dd662df865d59656373cf9ba14db24118c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b87ac1dd662df865d59656373cf9ba14db24118c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d6aa73aecbf1ba8be2940f65c3d96106035a8cb6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d6aa73aecbf1ba8be2940f65c3d96106035a8cb6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:abb1cfa84549a4c675d4b39e1d17d42a14461042', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abb1cfa84549a4c675d4b39e1d17d42a14461042', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f29852cf9aee8337ce1fcb117db0585090d458de', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f29852cf9aee8337ce1fcb117db0585090d458de', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8fc147c01d4a4b655d052ff7b5cf70c4d6303235', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8fc147c01d4a4b655d052ff7b5cf70c4d6303235', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc2ce2b6eb26391990faeb29dba5c9778212405c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc2ce2b6eb26391990faeb29dba5c9778212405c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7918b9ae8e8e8685b75322c6440260bb939683b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7918b9ae8e8e8685b75322c6440260bb939683b0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6a326d013fa855ebad7f4e110df776e30ebe056b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a326d013fa855ebad7f4e110df776e30ebe056b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a557f7ca573d420b9a98b8008bbcc8b99467d41c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a557f7ca573d420b9a98b8008bbcc8b99467d41c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ad4e1e1cc6f4c3daf133a8f90420184aff3fc7e2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ad4e1e1cc6f4c3daf133a8f90420184aff3fc7e2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:903cbfc3020b8a5ee16bf0cbf35304264572aa8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:903cbfc3020b8a5ee16bf0cbf35304264572aa8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ccba809b6df440a4f942b73b79c1e8a4b71ed31e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ccba809b6df440a4f942b73b79c1e8a4b71ed31e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bd95b91456ab88ed1a19f1f9782eb377947a4810', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bd95b91456ab88ed1a19f1f9782eb377947a4810', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0dbf4e43c21fd2602916f4c63c40a7dd87c98b38', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0dbf4e43c21fd2602916f4c63c40a7dd87c98b38', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b7996906c0e9195e6cc2d9b65d24c4855dbc5ab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b7996906c0e9195e6cc2d9b65d24c4855dbc5ab', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:44bde32b879f4f594faeddcb12f7c640feac5850', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:44bde32b879f4f594faeddcb12f7c640feac5850', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:debe28467bf98ce32274b3e94a20f1dffc900896', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:debe28467bf98ce32274b3e94a20f1dffc900896', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a7337f9f76e10eb38baa96eeb252775416cc0055', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a7337f9f76e10eb38baa96eeb252775416cc0055', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:796678e823362ed8150d0bfae4946a3b2fc3e04d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:796678e823362ed8150d0bfae4946a3b2fc3e04d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5557410a6c735a87d254e709cafa3c8057497a08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5557410a6c735a87d254e709cafa3c8057497a08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:24693ff4d99269d87daf98397242780f8e268357', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:24693ff4d99269d87daf98397242780f8e268357', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:789692036f32d3d0745c30f351d17f9e06a1bb3c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:789692036f32d3d0745c30f351d17f9e06a1bb3c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1079a7e0585329034092ba9fce4fff3a78f0cdd6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1079a7e0585329034092ba9fce4fff3a78f0cdd6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:33922d097bf9c72b0cefa6dbf87678462db06b67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:33922d097bf9c72b0cefa6dbf87678462db06b67', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7feb1643aa912db1e696b9151678e61ed60214e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7feb1643aa912db1e696b9151678e61ed60214e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f54527b930c2023d23c71b591baef4765439b211', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f54527b930c2023d23c71b591baef4765439b211', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:58abb641cf42acc4be7197d89aed8a7680ccd2fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:58abb641cf42acc4be7197d89aed8a7680ccd2fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d0024604316b9244cc324fdcd0567ab6c353f727', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d0024604316b9244cc324fdcd0567ab6c353f727', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:59f8913878a4117be694698a6a566fff66c64e46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59f8913878a4117be694698a6a566fff66c64e46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:00f1a4ecf8328ef2874b7ea921d6e4e51f2e83c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:00f1a4ecf8328ef2874b7ea921d6e4e51f2e83c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:64eb184a5b3c7a8ce7ce9dfe4d640b9948f726b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64eb184a5b3c7a8ce7ce9dfe4d640b9948f726b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:32738615e22da6d5fdb2c51cf6aabc8b379acc77', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:32738615e22da6d5fdb2c51cf6aabc8b379acc77', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b4eb4d9e12fb347e940d091058a34bca590e2607', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b4eb4d9e12fb347e940d091058a34bca590e2607', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:75d495b98e5a0e0700ff8b5068619f084f0c2c5d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:75d495b98e5a0e0700ff8b5068619f084f0c2c5d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc920111f1ee3ba8ce11c1e2f4b9992b72e889eb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc920111f1ee3ba8ce11c1e2f4b9992b72e889eb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:06f4bac3f0866ad466655eb8a8349d0b1b0f16b4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:06f4bac3f0866ad466655eb8a8349d0b1b0f16b4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:64c4362d1bd6053672a66b703496f88212202fef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64c4362d1bd6053672a66b703496f88212202fef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cf5a5876ce1f55d20d3b76d32fb794cfe4623818', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf5a5876ce1f55d20d3b76d32fb794cfe4623818', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:63e7918f80699058b38669aeee8fbe94582a25c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63e7918f80699058b38669aeee8fbe94582a25c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a0f37cfc1c99713d155d06538f3351cc65d5c388', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a0f37cfc1c99713d155d06538f3351cc65d5c388', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9628300bdee54ba15372d407120069c0946fe3f6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9628300bdee54ba15372d407120069c0946fe3f6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:75b2a7671c8b57a61424641b507a082bf5625e6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:75b2a7671c8b57a61424641b507a082bf5625e6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3f2057664f5d53d1fdc5610a55eb69ece795a62b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f2057664f5d53d1fdc5610a55eb69ece795a62b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ce2b349ffa2db22650913b3d85cd678796bf8732', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ce2b349ffa2db22650913b3d85cd678796bf8732', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b446ba8454fb6887537bc8cd3332890f04ae181c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b446ba8454fb6887537bc8cd3332890f04ae181c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:54740cfb37f2f77731cfb46766e0f2dac3eaebfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:54740cfb37f2f77731cfb46766e0f2dac3eaebfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e1724c225049feb33e655b708f0f24107e443bfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1724c225049feb33e655b708f0f24107e443bfa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f6fc7626a6ef6c37973f442ef416384e7b620456', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f6fc7626a6ef6c37973f442ef416384e7b620456', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f116612ab8f47c248a68cbdfa9b68c22c5f4dc08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f116612ab8f47c248a68cbdfa9b68c22c5f4dc08', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a07e2f4b0a35da7371a547d0eda47c56fb5278f1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a07e2f4b0a35da7371a547d0eda47c56fb5278f1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5ce22d148515df37fa551c582999bf8fe45e29fa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5ce22d148515df37fa551c582999bf8fe45e29fa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95f3d123b6d494a5f89469837b74667f35db441d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95f3d123b6d494a5f89469837b74667f35db441d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a4ee27bd9b56ee0612403e51f7f7c837d8f93930', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4ee27bd9b56ee0612403e51f7f7c837d8f93930', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b9f5a175c0931b074184c8aadeb800dead703020', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b9f5a175c0931b074184c8aadeb800dead703020', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2bbed1613748088b0d28f79689961a70bf760a57', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2bbed1613748088b0d28f79689961a70bf760a57', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e18ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d81d75a50d0ee2ff7a5d0494938446ab100e2475', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1900', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d81d75a50d0ee2ff7a5d0494938446ab100e2475', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1900', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:042bb1469216d2a916d35903e8a95a5337580f0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1901', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:042bb1469216d2a916d35903e8a95a5337580f0e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1901', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ab90b3328d9e33f77cdbb278aa1a286ebffede00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1902', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab90b3328d9e33f77cdbb278aa1a286ebffede00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1902', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fc3a32dd7311a3f9f11994d079b57b4034b478da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1903', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc3a32dd7311a3f9f11994d079b57b4034b478da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1903', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b6510d1f68798c04266d9c60a5058c184cfbd7f1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1904', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b6510d1f68798c04266d9c60a5058c184cfbd7f1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1904', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a3f57a95eeb40a83e556545621bf60354ea40567', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1905', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3f57a95eeb40a83e556545621bf60354ea40567', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1905', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f7766c5647f6befeb090a9cb34ae1054792e996a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1906', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f7766c5647f6befeb090a9cb34ae1054792e996a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1906', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc4b7f677f5ce7ae26246acb591e7e4ddf3d3b24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1907', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc4b7f677f5ce7ae26246acb591e7e4ddf3d3b24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1907', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:068ce9cdffe6241b1abeea9c69937015e35c6ed1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1908', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:068ce9cdffe6241b1abeea9c69937015e35c6ed1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1908', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0d9eecfb97da7c66f7032ee7bf08c61f94326f1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1909', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0d9eecfb97da7c66f7032ee7bf08c61f94326f1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1909', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fccdfd82db40f72e42e6be8aace4202906f832ba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fccdfd82db40f72e42e6be8aace4202906f832ba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5236929028348f3471f254f15591b4831256c31b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5236929028348f3471f254f15591b4831256c31b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:026134c7d60158109a7d528fa4fcc876d8272750', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:026134c7d60158109a7d528fa4fcc876d8272750', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3c802e740776584f1fa9b398103d38766e4e092e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3c802e740776584f1fa9b398103d38766e4e092e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:058369d6195bfa3ef5a377365af8d8b4814b2cf2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:058369d6195bfa3ef5a377365af8d8b4814b2cf2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e088fa0ab6dc0588d89e8785b17c050dc2c7413d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e088fa0ab6dc0588d89e8785b17c050dc2c7413d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e190f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:91be232ad4d24f77dbdf34d27f67c7a10e414d6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1910', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:91be232ad4d24f77dbdf34d27f67c7a10e414d6e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1910', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:667010afc17c6a5c4cddc8dd29921ec2c32f54f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1911', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:667010afc17c6a5c4cddc8dd29921ec2c32f54f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1911', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6c7a408a27bac6f38ad29c00e2fe9f5c0ea9b0ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1912', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c7a408a27bac6f38ad29c00e2fe9f5c0ea9b0ea', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1912', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b050d0e63cf7321d6823ee85afb1b2d2a829dc88', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1913', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b050d0e63cf7321d6823ee85afb1b2d2a829dc88', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1913', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a50b3eaa93d1dbe573d564f2563234ddc33e197', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1914', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a50b3eaa93d1dbe573d564f2563234ddc33e197', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1914', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b88a167d2f80a2e3f599fdd7d2f518753a66e374', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1915', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b88a167d2f80a2e3f599fdd7d2f518753a66e374', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1915', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:31292c99c76b801b511af51c6920b9ce2a53098f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1916', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31292c99c76b801b511af51c6920b9ce2a53098f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1916', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b5302288002ce79bb4f4a8901a0dec52871a214a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1917', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b5302288002ce79bb4f4a8901a0dec52871a214a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1917', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8aeccf1f43c9558e28a27bc5fa313776256aeaae', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1918', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8aeccf1f43c9558e28a27bc5fa313776256aeaae', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1918', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0cfb419269ddec990a6a75167f7f94078e25c60c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1919', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0cfb419269ddec990a6a75167f7f94078e25c60c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1919', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0dbe09a8b34df1647358e021db41243d7bdc81bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0dbe09a8b34df1647358e021db41243d7bdc81bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:83634301394c677bef5335b866ee4cf7cb51823c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:83634301394c677bef5335b866ee4cf7cb51823c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a1914b935aaa2efddae2bb3f8ae7ce0d34887a6b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a1914b935aaa2efddae2bb3f8ae7ce0d34887a6b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e264f13ddbe86e182047de690b38f3b7564365a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e264f13ddbe86e182047de690b38f3b7564365a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:65dc084a24f2a07c7c867de1e7d1e997619d102e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:65dc084a24f2a07c7c867de1e7d1e997619d102e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:44e25662fd1c6057d52ad08761533f653f665b1c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:44e25662fd1c6057d52ad08761533f653f665b1c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e191f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fd3aa70dfd4783e264c75f30095a87941f0189e0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1920', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd3aa70dfd4783e264c75f30095a87941f0189e0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1920', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc0e4aa4fe0fbbcab42f6cdcd9ecc5951efa2f1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1921', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc0e4aa4fe0fbbcab42f6cdcd9ecc5951efa2f1e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1921', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f39e055541173f1bee6417b6e5d9db13e6d257c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1922', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f39e055541173f1bee6417b6e5d9db13e6d257c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1922', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bbed43835ed470962a815b8c6a90914f401775a5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1923', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bbed43835ed470962a815b8c6a90914f401775a5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1923', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:76e19e15224b68c6a40ff064a6aaa9e7c51e6855', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1924', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:76e19e15224b68c6a40ff064a6aaa9e7c51e6855', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1924', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f8b2436c7c325a9ed293e08c8b230bf0f0919345', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1925', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8b2436c7c325a9ed293e08c8b230bf0f0919345', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1925', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:35a78991bf35fd284a6de64c5a4ab32b64b9f19b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1926', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:35a78991bf35fd284a6de64c5a4ab32b64b9f19b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1926', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:06b7fdfb4e464173ad8e5fcacadb03c9e888a4fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1927', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:06b7fdfb4e464173ad8e5fcacadb03c9e888a4fb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1927', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95d2c61c7297c9ca548bfb076b67d39d3fd89b3d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1928', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95d2c61c7297c9ca548bfb076b67d39d3fd89b3d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1928', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b5956ef7c737a6424f9eeb45fc33c6458dfd09c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1929', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b5956ef7c737a6424f9eeb45fc33c6458dfd09c2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1929', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2af60a35001b4c86ddbca5314a616db98c212545', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2af60a35001b4c86ddbca5314a616db98c212545', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:52fd06234117dead9e99692843be6eac86518a69', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52fd06234117dead9e99692843be6eac86518a69', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b0bca97a2bf7157688ac6117347691407ccde61e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b0bca97a2bf7157688ac6117347691407ccde61e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bb5f8bfaf323e26b19ff0e024fbf2c8aa4f968e3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bb5f8bfaf323e26b19ff0e024fbf2c8aa4f968e3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3313fd80d66b14ae9eacf3d528673dcfb592723d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3313fd80d66b14ae9eacf3d528673dcfb592723d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9b60ed9b10a5bc2b9d33f28795937a409bc8af84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b60ed9b10a5bc2b9d33f28795937a409bc8af84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e192f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:970ad0416e5896a975f41fffb86663587942ec52', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1930', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:970ad0416e5896a975f41fffb86663587942ec52', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1930', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f1a5c4cd03b7eded2b805dc175f112a6663b5ce4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1931', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f1a5c4cd03b7eded2b805dc175f112a6663b5ce4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1931', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:28100d3d7f5eab307ee5d9fa6514f72080a6896d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1932', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:28100d3d7f5eab307ee5d9fa6514f72080a6896d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1932', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2018dfbbcf1b559c9b3f12637088b9f5a8ad984e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1933', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2018dfbbcf1b559c9b3f12637088b9f5a8ad984e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1933', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a60412dfda4fb6b5027d08c26a9c14518a09d9a7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1934', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a60412dfda4fb6b5027d08c26a9c14518a09d9a7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1934', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:036e3170e3d82e32195e701a7804b90add860482', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1935', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:036e3170e3d82e32195e701a7804b90add860482', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1935', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aad88e0f082ec85a8ca302189761232dadc96a77', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1936', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aad88e0f082ec85a8ca302189761232dadc96a77', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1936', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:859951fdadb1ec0892f1aa282d3771670216fd97', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1937', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:859951fdadb1ec0892f1aa282d3771670216fd97', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1937', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:23253d61aad0f7de8e4ae4d8f3534bb41eaffef4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1938', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:23253d61aad0f7de8e4ae4d8f3534bb41eaffef4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1938', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f27265d16e6c00de401a8aaf3799bf0094aa5e00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1939', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f27265d16e6c00de401a8aaf3799bf0094aa5e00', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1939', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fba3fd63215694e93bac7322c37c2e4c6756a38a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fba3fd63215694e93bac7322c37c2e4c6756a38a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:12c830534126db765b856ca17dc0170ce61a4cd7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:12c830534126db765b856ca17dc0170ce61a4cd7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d425d358976a3270bdc4c0479bbd3479aad5b877', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d425d358976a3270bdc4c0479bbd3479aad5b877', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:37b385886bd0ebb7aaddeb368d2bee177ac2cdbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:37b385886bd0ebb7aaddeb368d2bee177ac2cdbd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7527e2977e414ce62f8123ee80daa6a7d619026e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7527e2977e414ce62f8123ee80daa6a7d619026e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a9889abb8e9c00125eab2107f06a6b28af0e85e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a9889abb8e9c00125eab2107f06a6b28af0e85e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e193f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e96c92324de9cd828a78ae728cdc4d11ba77e714', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1940', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e96c92324de9cd828a78ae728cdc4d11ba77e714', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1940', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0396258d9b645400867771e7797d5d2bc368c29a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1941', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0396258d9b645400867771e7797d5d2bc368c29a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1941', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2c03ae366ec3eaacec39a44dd0138ee70ab8583a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1942', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2c03ae366ec3eaacec39a44dd0138ee70ab8583a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1942', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dcd2a387ddada41b08323c666fbd774cfcc24a0b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1943', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dcd2a387ddada41b08323c666fbd774cfcc24a0b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1943', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6b56d38060157a53ea050e4143b04af2085d4f84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1944', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6b56d38060157a53ea050e4143b04af2085d4f84', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1944', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dcfeac871b75bfafe836fcc282632d0ff41a6231', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1945', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dcfeac871b75bfafe836fcc282632d0ff41a6231', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1945', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c3ab493791fa4cc4a91684f3c76f8531d357fe64', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1946', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3ab493791fa4cc4a91684f3c76f8531d357fe64', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1946', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9c1bb5bf853870187b3c231c7a363fe375292d8c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1947', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c1bb5bf853870187b3c231c7a363fe375292d8c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1947', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:80371f420611e9311a347ea6bbe40669ee0b149e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1948', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:80371f420611e9311a347ea6bbe40669ee0b149e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1948', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:980390e3003d699dc2dbc1e808163621ef045063', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1949', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:980390e3003d699dc2dbc1e808163621ef045063', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1949', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:547e5b73fd188921ad7549e2b93ac839c827c785', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:547e5b73fd188921ad7549e2b93ac839c827c785', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3d9b211a06ce128fd595df9590e00f11e53b449f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3d9b211a06ce128fd595df9590e00f11e53b449f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e6475b4da9a392a2ca60a68e2e5ae298b1ba1c5c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e6475b4da9a392a2ca60a68e2e5ae298b1ba1c5c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:004e806beba25b6b199541a9b4aebc89db0fceef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:004e806beba25b6b199541a9b4aebc89db0fceef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ee150ff6d59ee4ff13d81a4e6b5676680807b1ca', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee150ff6d59ee4ff13d81a4e6b5676680807b1ca', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3f496af2da08afe1b9a119c2169c5b967186c4a4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f496af2da08afe1b9a119c2169c5b967186c4a4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e194f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e02bb693a3b59e896b625ed252c8319ef18d110b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1950', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e02bb693a3b59e896b625ed252c8319ef18d110b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1950', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b90ce6519705b9bf8e6a0be75ddf92a2d654702a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1951', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b90ce6519705b9bf8e6a0be75ddf92a2d654702a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1951', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4ad3d23055d9255b5f615946282fbc253c09e027', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1952', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4ad3d23055d9255b5f615946282fbc253c09e027', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1952', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d904f72cef465c16757c8bbd2c85071374834043', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1953', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d904f72cef465c16757c8bbd2c85071374834043', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1953', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d83aa6f1db21108794c7d1dbabeb3c06d443d52c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1954', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d83aa6f1db21108794c7d1dbabeb3c06d443d52c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1954', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:523fd3858413116f581995dcc6b0a7424759070f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1955', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:523fd3858413116f581995dcc6b0a7424759070f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1955', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:71f9df00287d6b924db46267e563f1c4ba029264', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1956', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:71f9df00287d6b924db46267e563f1c4ba029264', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1956', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:be81a458fda387fe843487de5ef65ad732f06ec2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1957', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be81a458fda387fe843487de5ef65ad732f06ec2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1957', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:56:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6a308d652eb4e7547c432a0e0b1b33c02f73c647', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1958', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a308d652eb4e7547c432a0e0b1b33c02f73c647', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1958', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:57:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5bd42ff970ce446bd6dd85c61fec5a6337aeebbe', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5bd42ff970ce446bd6dd85c61fec5a6337aeebbe', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:57:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:97c3d3279140930686bed6b1fc15b5b86ace8dbf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:97c3d3279140930686bed6b1fc15b5b86ace8dbf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:57:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:06691d2ab86f736b6c25b49929711b4eedc475df', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:06691d2ab86f736b6c25b49929711b4eedc475df', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e195e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:57:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.461536] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.469454] Modules linked in:\n[    4.472514] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.480254] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.488946] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.493393] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.512136] RSP: 0018:ffffbc2c80033b30 EFLAGS: 00010246\n[    4.517361] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    4.524493] RDX: ffffbc2c80033b38 RSI: 0000000000000001 RDI: ffffbc2c80033b80\n[    4.531625] RBP: ffff9f58436388e8 R08: ffff9f584362f6f0 R09: ffff9f58435cc000\n[    4.538756] R10: 0000000000000040 R11: ffffffff93458840 R12: ffff9f5843600000\n[    4.545886] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.553019] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    4.561103] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.566847] CR2: 00007ff216b3e160 CR3: 0000000071c2e000 CR4: 00000000003506f0\n[    4.573977] Call Trace:\n[    4.576428]  <TASK>\n[    4.578533]  ? __warn+0x84/0x130\n[    4.581766]  ? __flush_work+0x2d6/0x300\n[    4.585606]  ? report_bug+0x164/0x190\n[    4.589275]  ? handle_bug+0x54/0x90\n[    4.592769]  ? exc_invalid_op+0x17/0x70\n[    4.596608]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.600797]  ? __flush_work+0x2d6/0x300\n[    4.604644]  cancel_delayed_work_sync+0x5c/0x80\n[    4.609176]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.613709]  amdgpu_ring_alloc+0x3e/0x60\n[    4.617635]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.622774]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.627218]  amdgpu_device_init+0x1e4f/0x2530\n[    4.631580]  amdgpu_driver_load_kms+0x14/0x80\n[    4.635942]  amdgpu_pci_probe+0x150/0x490\n[    4.639955]  local_pci_probe+0x3d/0x90\n[    4.643710]  pci_device_probe+0xb5/0x180\n[    4.647638]  really_probe+0xcc/0x2b0\n[    4.651219]  ? __pfx___driver_attach+0x10/0x10\n[    4.655664]  __driver_probe_device+0x6e/0x110\n[    4.660024]  driver_probe_device+0x1a/0xe0\n[    4.664122]  __driver_attach+0x83/0x180\n[    4.667962]  bus_for_each_dev+0x83/0xd0\n[    4.671802]  bus_add_driver+0xe3/0x210\n[    4.675555]  driver_register+0x54/0x100\n[    4.679392]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.683496]  do_one_initcall+0x56/0x220\n[    4.687336]  kernel_init_freeable+0x19e/0x2d0\n[    4.691698]  ? __pfx_kernel_init+0x10/0x10\n[    4.695797]  kernel_init+0x15/0x1c0\n[    4.699288]  ret_from_fork+0x2f/0x50\n[    4.702869]  ? __pfx_kernel_init+0x10/0x10\n[    4.706970]  ret_from_fork_asm+0x1a/0x30\n[    4.710897]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': "0e04c787f65 found\ndone.\nBegin: Waiting up to 180 secs for any network device to become available ... done.\n[    6.931450] acp3x-alc5682-max98357 AMDI5682:00: ASoC: driver name too long 'acp3xalc5682m98357' -> 'acp3xalc5682m98'\n[    6.932476] WARNING: CPU: 0 PID: 95 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.955467] input: acp3xalc5682m98357 Headset Jack as /devices/pci0000:00/0000:00:08.1/0000:04:00.5/AMDI5682:00/sound/card0/input11\n[    6.960551] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt cros_ec_lid_angle snd_sof_amd_renoir cros_ec_sensors cros_ec_sensors_core snd_sof_amd_acp snd_acp_config cros_ec_debugfs snd_sof_pci snd_sof_xtensa_dsp cros_usbpd_charger btusb cros_ec_hwmon cros_ec_sysfs cros_ec_sensorhub cros_usbpd_logger cros_ec_chardev cros_charge_control btrtl btintel uvcvideo snd_sof btbcm videobuf2_vmalloc snd_sof_utils videobuf2_memops btmtk cros_ec_dev uvc snd_soc_acpi snd_soc_acp_rt5682_mach videobuf2_v4l2 videobuf2_common bluetooth snd_pci_acp3x snd_soc_rt5682_i2c sp5100_tco snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 acp_audio_dma snd_soc_cros_ec_codec watchdog cros_ec_typec roles acpi_als industrialio_triggered_buffer vpd_sysfs memconsole_coreboot kfifo_buf iwlmvm gsmi snd_soc_max98357a iwlwifi i2c_piix4 regmap_i2c memconsole typec industrialio snd_soc_core cros_usbpd_notify i2c_cros_ec_tunnel chromeos_pstore snd_compress i2c_hid_acpi i2c_hid cros_kbd_led_backlight elan_i2c\n[    6.972467]  snd_pcm_dmaengine coreboot_table\n[    7.065528] CPU: 0 UID: 0 PID: 95 Comm: kworker/0:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.075006] Tainted: [W]=WARN\n[    7.077978] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    7.086670] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.093114] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.097563] Code: 70 9e 17 70 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.116309] RSP: 0018:ffffbc2c80cbbc70 EFLAGS: 00010246\n[    7.121534] RAX: 0000000000000000 RBX: ffff9f58436388e8 RCX: 0000000000000000\n[    7.128669] RDX: ffffbc2c80cbbc78 RSI: 0000000000000001 RDI: ffffbc2c80cbbcc0\n[    7.135803] RBP: ffff9f58436388e8 R08: ffffbc2c80cbbdf0 R09: 0000000000000000\n[    7.142932] R10: ffffbc2c80cbbb38 R11: ffff9f5845fa4100 R12: 00000000000003e8\n[    7.150063] R13: 0000000000000001 R14: ffff9f5843600000 R15: ffff9f58436323c0\n[    7.157195] FS:  0000000000000000(0000) GS:ffff9f586ae00000(0000) knlGS:0000000000000000\n[    7.165283] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.171029] CR2: 00007f247a349328 CR3: 000000010720e000 CR4: 00000000003506f0\n[    7.178162] Call Trace:\n[    7.180616]  <TASK>\n[    7.182720]  ? __warn+0x84/0x130\n[    7.185955]  ? __flush_work+0x2d6/0x300\n[    7.189797]  ? report_bug+0x164/0x190\n[    7.193468]  ? handle_bug+0x54/0x90\n[    7.196960]  ? exc_invalid_op+0x17/0x70\n[    7.200800]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.204991]  ? __flush_work+0x2d6/0x300\n[    7.208833]  cancel_delayed_work_sync+0x5c/0x80\n[    7.213367]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.217902]  amdgpu_ring_alloc+0x3e/0x60\n[    7.221829]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.225932]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.230466]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.235432]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.239791]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.245623]  process_one_work+0x163/0x390\n[    7.249637]  worker_thread+0x2a0/0x3b0\n[    7.253389]  ? __pfx_worker_thread+0x10/0x10\n[    7.257664]  ? __pfx_worker_thread+0x10/0x10\n[    7.261936]  kthread+0xcb/0xf0\n[    7.264994]  ? __pfx_kthread+0x10/0x10\n[    7.268747]  ret_from_fork+0x2f/0x50\n[    7.272329]  ? __pfx_kthread+0x10/0x10\n[    7.276081]  ret_from_fork_asm+0x1a/0x30\n[    7.280010]  </TASK>\n", 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:be1acc90095e8da1d3c31ac4365ce3379ad037f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1960', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be1acc90095e8da1d3c31ac4365ce3379ad037f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ebe11fb139cb87e1960', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1211fb139cb87dfabd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e187f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1880
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1881
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1882
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1883
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1884
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1885
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1886
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1887
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1888
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1889
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e188f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1890
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1891
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1892
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1893
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1894
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1895
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1896
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1897
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1898
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1899
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e189f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18a9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18aa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ab
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ac
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ad
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ae
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18af
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18b9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ba
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18bb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18bc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18bd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18be
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18bf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18c9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ca
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18cb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18cc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18cd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ce
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18cf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18d9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18da
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18db
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18dc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18dd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18de
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18df
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18e9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18eb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ec
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ed
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ee
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18f9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18fa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18fc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18fd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18fe
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e18ff
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1900
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1901
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1902
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1903
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1904
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1905
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1906
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1907
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1908
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1909
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e190f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1910
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1911
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1912
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1913
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1914
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1915
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1916
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1917
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1918
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1919
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e191f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1920
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1921
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1922
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1923
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1924
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1925
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1926
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1927
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1928
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1929
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e192f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1930
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1931
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1932
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1933
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1934
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1935
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1936
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1937
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1938
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1939
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e193f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1940
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1941
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1942
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1943
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1944
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1945
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1946
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1947
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1948
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1949
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e194f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1950
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1951
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1952
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1953
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1954
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1955
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1956
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1957
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1958
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e195a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e195c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e195e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1960
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebe11fb139cb87e1962
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fc4255bcf1ea95396d4c44cf08968dbabdbb55a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fc4255bcf1ea95396d4c44cf08968dbabdbb55a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efe0c6fe2eba2b64e7d9bce35176d7cde7c9cff8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efe0c6fe2eba2b64e7d9bce35176d7cde7c9cff8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9cb50a08e16014a167fe5accaedeb28641cb983a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9cb50a08e16014a167fe5accaedeb28641cb983a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d69d078902976d0c7c79f58bb6b8e3b1a9abbb08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d69d078902976d0c7c79f58bb6b8e3b1a9abbb08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:856ab577f068af6a2e4d00f7fd4b5155b3756120
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:856ab577f068af6a2e4d00f7fd4b5155b3756120
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:838aff77d3e6616d90d5ecdee1275fb4ec76ea27
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:838aff77d3e6616d90d5ecdee1275fb4ec76ea27
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ccf52975e27ebf28925fc7caa1169a0408d40e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ccf52975e27ebf28925fc7caa1169a0408d40e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53cb8d7c06617fa51e78f0fe91221c49a3100c2e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53cb8d7c06617fa51e78f0fe91221c49a3100c2e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:231f3d67b7d1042d0df051a0ceb462007221ba81
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:231f3d67b7d1042d0df051a0ceb462007221ba81
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06e8bbfa3c716f694237235080a9f7bc86a1d99b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06e8bbfa3c716f694237235080a9f7bc86a1d99b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6449ae1a94e40d5fa8b04abc69d2503d96bdee0d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6449ae1a94e40d5fa8b04abc69d2503d96bdee0d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91b911ec7418b27546f553089193a112a440f2ef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91b911ec7418b27546f553089193a112a440f2ef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab7655d2de284dcf41af1cc1174247cf1e60194b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab7655d2de284dcf41af1cc1174247cf1e60194b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b5dbcf0ea52ead193708baf9e0c12d2f7bf37d6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b5dbcf0ea52ead193708baf9e0c12d2f7bf37d6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ffb4334e6f7bbf5eebf9776189745caf06f3df6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ffb4334e6f7bbf5eebf9776189745caf06f3df6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e083b94d5afa050f58649fcfe90eb27f267a341b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e083b94d5afa050f58649fcfe90eb27f267a341b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2954231d8ff6c52b44fc89061754d1f82e2b23bf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2954231d8ff6c52b44fc89061754d1f82e2b23bf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca83712b1bf5c29fbd1a0aad1205db847fda5ee6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca83712b1bf5c29fbd1a0aad1205db847fda5ee6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc9d2048223ed288336cc908ee8c8b505dc9491d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc9d2048223ed288336cc908ee8c8b505dc9491d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7efd7ea4571d6dcb53bc677bdd6f153f3edce7ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7efd7ea4571d6dcb53bc677bdd6f153f3edce7ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b40f9fd5d658cf7a991e9b696a203a0dd54b89e1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b40f9fd5d658cf7a991e9b696a203a0dd54b89e1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98eee9f41ed0e610a0787e7adc710cfda9b125a4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98eee9f41ed0e610a0787e7adc710cfda9b125a4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e254d8aef4990ebdaca0a0558d99d6f8bd19ac84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e254d8aef4990ebdaca0a0558d99d6f8bd19ac84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62e3d377747c6580556f8866fb725ec09bc30b2a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62e3d377747c6580556f8866fb725ec09bc30b2a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c3c71cee0cb890ec23d7c2669e8ba55005823d8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c3c71cee0cb890ec23d7c2669e8ba55005823d8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3cf31287b42d1d429edebb60ad4d61ca180c523
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3cf31287b42d1d429edebb60ad4d61ca180c523
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a69e745fec0448e6c18300d8082de5cd7eaa5078
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a69e745fec0448e6c18300d8082de5cd7eaa5078
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31e04756b0f487804a8008b61e550ad0c042a207
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31e04756b0f487804a8008b61e550ad0c042a207
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a958e1d65fe10b677f0adf6405208c44ffddafa9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a958e1d65fe10b677f0adf6405208c44ffddafa9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be0b624243772b5db88f6c565e266caf39e838b4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be0b624243772b5db88f6c565e266caf39e838b4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec20765fb045093775f52b70a53b7d9f74609e22
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec20765fb045093775f52b70a53b7d9f74609e22
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18c66f7fd52b3060c97e6750c88d6010db4a303e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18c66f7fd52b3060c97e6750c88d6010db4a303e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:778cc285a266bf4dbcbf172012a12fde6c30dde9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:778cc285a266bf4dbcbf172012a12fde6c30dde9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c17cf0fac5260dccdd4063a43f2b99afeb606c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c17cf0fac5260dccdd4063a43f2b99afeb606c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee8cf8d82f609b24624a1c5cc04665fe5d7c05ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee8cf8d82f609b24624a1c5cc04665fe5d7c05ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34abd95cabb0c49f18116930aaa96518e4ecbf9f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34abd95cabb0c49f18116930aaa96518e4ecbf9f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c23b9c67e1ce1de825b52afa4d61344bd45c6a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c23b9c67e1ce1de825b52afa4d61344bd45c6a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d91cc6ab74a4a91305e228befecd9ff88c3cdc4e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d91cc6ab74a4a91305e228befecd9ff88c3cdc4e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0551a7567405fef5d0ee1a88105e84ce97d4dabc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0551a7567405fef5d0ee1a88105e84ce97d4dabc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75078e9fe4285997737662706f6e7dea18897d78
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75078e9fe4285997737662706f6e7dea18897d78
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f8559c1ff56eabe31987489f35bda09741188b0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f8559c1ff56eabe31987489f35bda09741188b0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9eaee70e2767ac3b0a03c083736e51de332214b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9eaee70e2767ac3b0a03c083736e51de332214b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c86c2d793dec5747dadfcb48c3aae64ed98dbe4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c86c2d793dec5747dadfcb48c3aae64ed98dbe4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1403475f77abe7b75901705f973a477c00036384
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1403475f77abe7b75901705f973a477c00036384
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a3bb869891c29be27efd1f6793ad511baf4a4fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a3bb869891c29be27efd1f6793ad511baf4a4fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70d1bf40203d3562674e9fb8fb2ff6a666750113
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70d1bf40203d3562674e9fb8fb2ff6a666750113
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b57f6c1243f56a6d23a3df12ef5eac5a27d47b1e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b57f6c1243f56a6d23a3df12ef5eac5a27d47b1e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6f09d24fbfd62b6fc94e803b12de9a74a0f7eab6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6f09d24fbfd62b6fc94e803b12de9a74a0f7eab6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a2635e876bdfcb22cb8492c59f4ef117a09fb8b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a2635e876bdfcb22cb8492c59f4ef117a09fb8b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbbaea6aa5862a41005ed189b5b839a01a1e797b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbbaea6aa5862a41005ed189b5b839a01a1e797b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8326a2fb6ccd24680a0d445f02eb2a1f8091f348
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8326a2fb6ccd24680a0d445f02eb2a1f8091f348
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2ea4c2914ea551a97c8d1033f43b01f7f780189
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2ea4c2914ea551a97c8d1033f43b01f7f780189
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88d16b90bbdb57a7367dae6a7857116a8e47faf0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88d16b90bbdb57a7367dae6a7857116a8e47faf0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47449fefd139c3b3746316fafe8e93cbcb188426
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47449fefd139c3b3746316fafe8e93cbcb188426
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d82a70e339ec3a6fe2f9ed9b07e8f89a50be5a46
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d82a70e339ec3a6fe2f9ed9b07e8f89a50be5a46
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c6e2406f44ac52c4be3544c40578d711f805864
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c6e2406f44ac52c4be3544c40578d711f805864
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de0c102f80edf0a3ea6b95d629ebae56fdf5dd69
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de0c102f80edf0a3ea6b95d629ebae56fdf5dd69
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92100ce710cbb5cb4eb109ce1be7f64843ed4ef4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92100ce710cbb5cb4eb109ce1be7f64843ed4ef4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39e56a1822ced3b7361761a80352707afa199dd0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39e56a1822ced3b7361761a80352707afa199dd0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a93aeb6f130b550974a862deaa9d561c3faea0b3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a93aeb6f130b550974a862deaa9d561c3faea0b3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56596bc782cca258142ce7c0990e3d9dfe995c56
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56596bc782cca258142ce7c0990e3d9dfe995c56
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39e4b67ce3055690b25a0ad4714592a9fafed6c6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39e4b67ce3055690b25a0ad4714592a9fafed6c6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b05622d88039d5ae589ea1367d2237771e22620
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b05622d88039d5ae589ea1367d2237771e22620
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f52094a0d218815333224886e5f208f3ca87e7d7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f52094a0d218815333224886e5f208f3ca87e7d7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f766d1e0f1468b836d29aa7750f6eb135c528518
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f766d1e0f1468b836d29aa7750f6eb135c528518
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec4d45e345b5adb82288d3ecdfa5a018f8448d3b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec4d45e345b5adb82288d3ecdfa5a018f8448d3b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d700b16ce497479e1f391ddeb942bbdff147b57c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d700b16ce497479e1f391ddeb942bbdff147b57c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1963bd9ad92b3b88f964686cd114488b5a0ef582
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1963bd9ad92b3b88f964686cd114488b5a0ef582
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a35113f9d3e0c800269eac77c46a74b272206cdc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a35113f9d3e0c800269eac77c46a74b272206cdc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6f56b70fe2f935e4404ed07857fedcefd3a3cd9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6f56b70fe2f935e4404ed07857fedcefd3a3cd9
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2401c88f65590757ced3599f5a6bf601305d19f8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2401c88f65590757ced3599f5a6bf601305d19f8
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b87ac1dd662df865d59656373cf9ba14db24118c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b87ac1dd662df865d59656373cf9ba14db24118c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6aa73aecbf1ba8be2940f65c3d96106035a8cb6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6aa73aecbf1ba8be2940f65c3d96106035a8cb6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abb1cfa84549a4c675d4b39e1d17d42a14461042
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abb1cfa84549a4c675d4b39e1d17d42a14461042
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f29852cf9aee8337ce1fcb117db0585090d458de
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f29852cf9aee8337ce1fcb117db0585090d458de
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8fc147c01d4a4b655d052ff7b5cf70c4d6303235
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8fc147c01d4a4b655d052ff7b5cf70c4d6303235
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc2ce2b6eb26391990faeb29dba5c9778212405c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc2ce2b6eb26391990faeb29dba5c9778212405c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7918b9ae8e8e8685b75322c6440260bb939683b0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7918b9ae8e8e8685b75322c6440260bb939683b0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a326d013fa855ebad7f4e110df776e30ebe056b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a326d013fa855ebad7f4e110df776e30ebe056b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a557f7ca573d420b9a98b8008bbcc8b99467d41c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a557f7ca573d420b9a98b8008bbcc8b99467d41c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad4e1e1cc6f4c3daf133a8f90420184aff3fc7e2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad4e1e1cc6f4c3daf133a8f90420184aff3fc7e2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:903cbfc3020b8a5ee16bf0cbf35304264572aa8d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:903cbfc3020b8a5ee16bf0cbf35304264572aa8d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ccba809b6df440a4f942b73b79c1e8a4b71ed31e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ccba809b6df440a4f942b73b79c1e8a4b71ed31e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd95b91456ab88ed1a19f1f9782eb377947a4810
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd95b91456ab88ed1a19f1f9782eb377947a4810
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dbf4e43c21fd2602916f4c63c40a7dd87c98b38
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dbf4e43c21fd2602916f4c63c40a7dd87c98b38
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b7996906c0e9195e6cc2d9b65d24c4855dbc5ab
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b7996906c0e9195e6cc2d9b65d24c4855dbc5ab
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44bde32b879f4f594faeddcb12f7c640feac5850
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44bde32b879f4f594faeddcb12f7c640feac5850
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:debe28467bf98ce32274b3e94a20f1dffc900896
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:debe28467bf98ce32274b3e94a20f1dffc900896
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7337f9f76e10eb38baa96eeb252775416cc0055
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7337f9f76e10eb38baa96eeb252775416cc0055
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:796678e823362ed8150d0bfae4946a3b2fc3e04d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:796678e823362ed8150d0bfae4946a3b2fc3e04d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5557410a6c735a87d254e709cafa3c8057497a08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5557410a6c735a87d254e709cafa3c8057497a08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24693ff4d99269d87daf98397242780f8e268357
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24693ff4d99269d87daf98397242780f8e268357
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:789692036f32d3d0745c30f351d17f9e06a1bb3c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:789692036f32d3d0745c30f351d17f9e06a1bb3c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1079a7e0585329034092ba9fce4fff3a78f0cdd6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1079a7e0585329034092ba9fce4fff3a78f0cdd6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33922d097bf9c72b0cefa6dbf87678462db06b67
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33922d097bf9c72b0cefa6dbf87678462db06b67
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7feb1643aa912db1e696b9151678e61ed60214e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7feb1643aa912db1e696b9151678e61ed60214e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f54527b930c2023d23c71b591baef4765439b211
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f54527b930c2023d23c71b591baef4765439b211
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58abb641cf42acc4be7197d89aed8a7680ccd2fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58abb641cf42acc4be7197d89aed8a7680ccd2fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d0024604316b9244cc324fdcd0567ab6c353f727
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d0024604316b9244cc324fdcd0567ab6c353f727
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59f8913878a4117be694698a6a566fff66c64e46
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59f8913878a4117be694698a6a566fff66c64e46
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:00f1a4ecf8328ef2874b7ea921d6e4e51f2e83c0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:00f1a4ecf8328ef2874b7ea921d6e4e51f2e83c0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64eb184a5b3c7a8ce7ce9dfe4d640b9948f726b3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64eb184a5b3c7a8ce7ce9dfe4d640b9948f726b3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32738615e22da6d5fdb2c51cf6aabc8b379acc77
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32738615e22da6d5fdb2c51cf6aabc8b379acc77
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4eb4d9e12fb347e940d091058a34bca590e2607
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4eb4d9e12fb347e940d091058a34bca590e2607
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75d495b98e5a0e0700ff8b5068619f084f0c2c5d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75d495b98e5a0e0700ff8b5068619f084f0c2c5d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc920111f1ee3ba8ce11c1e2f4b9992b72e889eb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc920111f1ee3ba8ce11c1e2f4b9992b72e889eb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06f4bac3f0866ad466655eb8a8349d0b1b0f16b4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06f4bac3f0866ad466655eb8a8349d0b1b0f16b4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c4362d1bd6053672a66b703496f88212202fef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64c4362d1bd6053672a66b703496f88212202fef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf5a5876ce1f55d20d3b76d32fb794cfe4623818
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf5a5876ce1f55d20d3b76d32fb794cfe4623818
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63e7918f80699058b38669aeee8fbe94582a25c0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63e7918f80699058b38669aeee8fbe94582a25c0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0f37cfc1c99713d155d06538f3351cc65d5c388
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0f37cfc1c99713d155d06538f3351cc65d5c388
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9628300bdee54ba15372d407120069c0946fe3f6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9628300bdee54ba15372d407120069c0946fe3f6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75b2a7671c8b57a61424641b507a082bf5625e6d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75b2a7671c8b57a61424641b507a082bf5625e6d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f2057664f5d53d1fdc5610a55eb69ece795a62b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f2057664f5d53d1fdc5610a55eb69ece795a62b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce2b349ffa2db22650913b3d85cd678796bf8732
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce2b349ffa2db22650913b3d85cd678796bf8732
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b446ba8454fb6887537bc8cd3332890f04ae181c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b446ba8454fb6887537bc8cd3332890f04ae181c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54740cfb37f2f77731cfb46766e0f2dac3eaebfc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54740cfb37f2f77731cfb46766e0f2dac3eaebfc
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1724c225049feb33e655b708f0f24107e443bfa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1724c225049feb33e655b708f0f24107e443bfa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6fc7626a6ef6c37973f442ef416384e7b620456
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6fc7626a6ef6c37973f442ef416384e7b620456
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f116612ab8f47c248a68cbdfa9b68c22c5f4dc08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f116612ab8f47c248a68cbdfa9b68c22c5f4dc08
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a07e2f4b0a35da7371a547d0eda47c56fb5278f1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a07e2f4b0a35da7371a547d0eda47c56fb5278f1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ce22d148515df37fa551c582999bf8fe45e29fa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ce22d148515df37fa551c582999bf8fe45e29fa
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95f3d123b6d494a5f89469837b74667f35db441d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95f3d123b6d494a5f89469837b74667f35db441d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4ee27bd9b56ee0612403e51f7f7c837d8f93930
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4ee27bd9b56ee0612403e51f7f7c837d8f93930
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9f5a175c0931b074184c8aadeb800dead703020
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9f5a175c0931b074184c8aadeb800dead703020
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bbed1613748088b0d28f79689961a70bf760a57
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bbed1613748088b0d28f79689961a70bf760a57
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d81d75a50d0ee2ff7a5d0494938446ab100e2475
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d81d75a50d0ee2ff7a5d0494938446ab100e2475
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:042bb1469216d2a916d35903e8a95a5337580f0e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:042bb1469216d2a916d35903e8a95a5337580f0e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab90b3328d9e33f77cdbb278aa1a286ebffede00
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab90b3328d9e33f77cdbb278aa1a286ebffede00
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc3a32dd7311a3f9f11994d079b57b4034b478da
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc3a32dd7311a3f9f11994d079b57b4034b478da
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6510d1f68798c04266d9c60a5058c184cfbd7f1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6510d1f68798c04266d9c60a5058c184cfbd7f1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3f57a95eeb40a83e556545621bf60354ea40567
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3f57a95eeb40a83e556545621bf60354ea40567
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7766c5647f6befeb090a9cb34ae1054792e996a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7766c5647f6befeb090a9cb34ae1054792e996a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc4b7f677f5ce7ae26246acb591e7e4ddf3d3b24
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc4b7f677f5ce7ae26246acb591e7e4ddf3d3b24
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:068ce9cdffe6241b1abeea9c69937015e35c6ed1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:068ce9cdffe6241b1abeea9c69937015e35c6ed1
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d9eecfb97da7c66f7032ee7bf08c61f94326f1d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d9eecfb97da7c66f7032ee7bf08c61f94326f1d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fccdfd82db40f72e42e6be8aace4202906f832ba
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fccdfd82db40f72e42e6be8aace4202906f832ba
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5236929028348f3471f254f15591b4831256c31b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5236929028348f3471f254f15591b4831256c31b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:026134c7d60158109a7d528fa4fcc876d8272750
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:026134c7d60158109a7d528fa4fcc876d8272750
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c802e740776584f1fa9b398103d38766e4e092e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c802e740776584f1fa9b398103d38766e4e092e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:058369d6195bfa3ef5a377365af8d8b4814b2cf2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:058369d6195bfa3ef5a377365af8d8b4814b2cf2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e088fa0ab6dc0588d89e8785b17c050dc2c7413d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e088fa0ab6dc0588d89e8785b17c050dc2c7413d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91be232ad4d24f77dbdf34d27f67c7a10e414d6e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91be232ad4d24f77dbdf34d27f67c7a10e414d6e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:667010afc17c6a5c4cddc8dd29921ec2c32f54f0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:667010afc17c6a5c4cddc8dd29921ec2c32f54f0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c7a408a27bac6f38ad29c00e2fe9f5c0ea9b0ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c7a408a27bac6f38ad29c00e2fe9f5c0ea9b0ea
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b050d0e63cf7321d6823ee85afb1b2d2a829dc88
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b050d0e63cf7321d6823ee85afb1b2d2a829dc88
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a50b3eaa93d1dbe573d564f2563234ddc33e197
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a50b3eaa93d1dbe573d564f2563234ddc33e197
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b88a167d2f80a2e3f599fdd7d2f518753a66e374
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b88a167d2f80a2e3f599fdd7d2f518753a66e374
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31292c99c76b801b511af51c6920b9ce2a53098f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31292c99c76b801b511af51c6920b9ce2a53098f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5302288002ce79bb4f4a8901a0dec52871a214a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5302288002ce79bb4f4a8901a0dec52871a214a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8aeccf1f43c9558e28a27bc5fa313776256aeaae
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8aeccf1f43c9558e28a27bc5fa313776256aeaae
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0cfb419269ddec990a6a75167f7f94078e25c60c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0cfb419269ddec990a6a75167f7f94078e25c60c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dbe09a8b34df1647358e021db41243d7bdc81bf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dbe09a8b34df1647358e021db41243d7bdc81bf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83634301394c677bef5335b866ee4cf7cb51823c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83634301394c677bef5335b866ee4cf7cb51823c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1914b935aaa2efddae2bb3f8ae7ce0d34887a6b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1914b935aaa2efddae2bb3f8ae7ce0d34887a6b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e264f13ddbe86e182047de690b38f3b7564365a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e264f13ddbe86e182047de690b38f3b7564365a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65dc084a24f2a07c7c867de1e7d1e997619d102e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65dc084a24f2a07c7c867de1e7d1e997619d102e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44e25662fd1c6057d52ad08761533f653f665b1c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44e25662fd1c6057d52ad08761533f653f665b1c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd3aa70dfd4783e264c75f30095a87941f0189e0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd3aa70dfd4783e264c75f30095a87941f0189e0
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc0e4aa4fe0fbbcab42f6cdcd9ecc5951efa2f1e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc0e4aa4fe0fbbcab42f6cdcd9ecc5951efa2f1e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f39e055541173f1bee6417b6e5d9db13e6d257c6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f39e055541173f1bee6417b6e5d9db13e6d257c6
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bbed43835ed470962a815b8c6a90914f401775a5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bbed43835ed470962a815b8c6a90914f401775a5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:76e19e15224b68c6a40ff064a6aaa9e7c51e6855
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:76e19e15224b68c6a40ff064a6aaa9e7c51e6855
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8b2436c7c325a9ed293e08c8b230bf0f0919345
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8b2436c7c325a9ed293e08c8b230bf0f0919345
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35a78991bf35fd284a6de64c5a4ab32b64b9f19b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35a78991bf35fd284a6de64c5a4ab32b64b9f19b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06b7fdfb4e464173ad8e5fcacadb03c9e888a4fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06b7fdfb4e464173ad8e5fcacadb03c9e888a4fb
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95d2c61c7297c9ca548bfb076b67d39d3fd89b3d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95d2c61c7297c9ca548bfb076b67d39d3fd89b3d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5956ef7c737a6424f9eeb45fc33c6458dfd09c2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5956ef7c737a6424f9eeb45fc33c6458dfd09c2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2af60a35001b4c86ddbca5314a616db98c212545
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2af60a35001b4c86ddbca5314a616db98c212545
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52fd06234117dead9e99692843be6eac86518a69
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52fd06234117dead9e99692843be6eac86518a69
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b0bca97a2bf7157688ac6117347691407ccde61e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b0bca97a2bf7157688ac6117347691407ccde61e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb5f8bfaf323e26b19ff0e024fbf2c8aa4f968e3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb5f8bfaf323e26b19ff0e024fbf2c8aa4f968e3
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3313fd80d66b14ae9eacf3d528673dcfb592723d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3313fd80d66b14ae9eacf3d528673dcfb592723d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b60ed9b10a5bc2b9d33f28795937a409bc8af84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b60ed9b10a5bc2b9d33f28795937a409bc8af84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:970ad0416e5896a975f41fffb86663587942ec52
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:970ad0416e5896a975f41fffb86663587942ec52
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1a5c4cd03b7eded2b805dc175f112a6663b5ce4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1a5c4cd03b7eded2b805dc175f112a6663b5ce4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28100d3d7f5eab307ee5d9fa6514f72080a6896d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28100d3d7f5eab307ee5d9fa6514f72080a6896d
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2018dfbbcf1b559c9b3f12637088b9f5a8ad984e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2018dfbbcf1b559c9b3f12637088b9f5a8ad984e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a60412dfda4fb6b5027d08c26a9c14518a09d9a7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a60412dfda4fb6b5027d08c26a9c14518a09d9a7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:036e3170e3d82e32195e701a7804b90add860482
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:036e3170e3d82e32195e701a7804b90add860482
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aad88e0f082ec85a8ca302189761232dadc96a77
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aad88e0f082ec85a8ca302189761232dadc96a77
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:859951fdadb1ec0892f1aa282d3771670216fd97
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:859951fdadb1ec0892f1aa282d3771670216fd97
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23253d61aad0f7de8e4ae4d8f3534bb41eaffef4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23253d61aad0f7de8e4ae4d8f3534bb41eaffef4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f27265d16e6c00de401a8aaf3799bf0094aa5e00
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f27265d16e6c00de401a8aaf3799bf0094aa5e00
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fba3fd63215694e93bac7322c37c2e4c6756a38a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fba3fd63215694e93bac7322c37c2e4c6756a38a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12c830534126db765b856ca17dc0170ce61a4cd7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12c830534126db765b856ca17dc0170ce61a4cd7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d425d358976a3270bdc4c0479bbd3479aad5b877
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d425d358976a3270bdc4c0479bbd3479aad5b877
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:37b385886bd0ebb7aaddeb368d2bee177ac2cdbd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:37b385886bd0ebb7aaddeb368d2bee177ac2cdbd
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7527e2977e414ce62f8123ee80daa6a7d619026e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7527e2977e414ce62f8123ee80daa6a7d619026e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9889abb8e9c00125eab2107f06a6b28af0e85e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9889abb8e9c00125eab2107f06a6b28af0e85e7
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e96c92324de9cd828a78ae728cdc4d11ba77e714
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e96c92324de9cd828a78ae728cdc4d11ba77e714
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0396258d9b645400867771e7797d5d2bc368c29a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0396258d9b645400867771e7797d5d2bc368c29a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2c03ae366ec3eaacec39a44dd0138ee70ab8583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2c03ae366ec3eaacec39a44dd0138ee70ab8583a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcd2a387ddada41b08323c666fbd774cfcc24a0b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcd2a387ddada41b08323c666fbd774cfcc24a0b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b56d38060157a53ea050e4143b04af2085d4f84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b56d38060157a53ea050e4143b04af2085d4f84
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcfeac871b75bfafe836fcc282632d0ff41a6231
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcfeac871b75bfafe836fcc282632d0ff41a6231
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3ab493791fa4cc4a91684f3c76f8531d357fe64
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3ab493791fa4cc4a91684f3c76f8531d357fe64
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c1bb5bf853870187b3c231c7a363fe375292d8c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c1bb5bf853870187b3c231c7a363fe375292d8c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:80371f420611e9311a347ea6bbe40669ee0b149e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:80371f420611e9311a347ea6bbe40669ee0b149e
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:980390e3003d699dc2dbc1e808163621ef045063
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:980390e3003d699dc2dbc1e808163621ef045063
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:547e5b73fd188921ad7549e2b93ac839c827c785
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:547e5b73fd188921ad7549e2b93ac839c827c785
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d9b211a06ce128fd595df9590e00f11e53b449f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d9b211a06ce128fd595df9590e00f11e53b449f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e6475b4da9a392a2ca60a68e2e5ae298b1ba1c5c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e6475b4da9a392a2ca60a68e2e5ae298b1ba1c5c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:004e806beba25b6b199541a9b4aebc89db0fceef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:004e806beba25b6b199541a9b4aebc89db0fceef
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee150ff6d59ee4ff13d81a4e6b5676680807b1ca
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee150ff6d59ee4ff13d81a4e6b5676680807b1ca
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f496af2da08afe1b9a119c2169c5b967186c4a4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f496af2da08afe1b9a119c2169c5b967186c4a4
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e02bb693a3b59e896b625ed252c8319ef18d110b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e02bb693a3b59e896b625ed252c8319ef18d110b
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b90ce6519705b9bf8e6a0be75ddf92a2d654702a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b90ce6519705b9bf8e6a0be75ddf92a2d654702a
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ad3d23055d9255b5f615946282fbc253c09e027
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ad3d23055d9255b5f615946282fbc253c09e027
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d904f72cef465c16757c8bbd2c85071374834043
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d904f72cef465c16757c8bbd2c85071374834043
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d83aa6f1db21108794c7d1dbabeb3c06d443d52c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d83aa6f1db21108794c7d1dbabeb3c06d443d52c
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:523fd3858413116f581995dcc6b0a7424759070f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:523fd3858413116f581995dcc6b0a7424759070f
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71f9df00287d6b924db46267e563f1c4ba029264
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71f9df00287d6b924db46267e563f1c4ba029264
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be81a458fda387fe843487de5ef65ad732f06ec2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be81a458fda387fe843487de5ef65ad732f06ec2
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a308d652eb4e7547c432a0e0b1b33c02f73c647
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a308d652eb4e7547c432a0e0b1b33c02f73c647
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5bd42ff970ce446bd6dd85c61fec5a6337aeebbe
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5bd42ff970ce446bd6dd85c61fec5a6337aeebbe
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:97c3d3279140930686bed6b1fc15b5b86ace8dbf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:97c3d3279140930686bed6b1fc15b5b86ace8dbf
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06691d2ab86f736b6c25b49929711b4eedc475df
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06691d2ab86f736b6c25b49929711b4eedc475df
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be1acc90095e8da1d3c31ac4365ce3379ad037f5
11/22/2024 12:57:00 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be1acc90095e8da1d3c31ac4365ce3379ad037f5
11/22/2024 12:57:01 PM UTC [INFO] Received an event for node: 67406df411fb139cb87dffa3
11/22/2024 12:57:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df411fb139cb87dffa3
11/22/2024 12:57:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebf11fb139cb87e1969
11/22/2024 12:57:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebf11fb139cb87e196a
11/22/2024 12:57:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ebf11fb139cb87e196b
11/22/2024 12:57:04 PM UTC [INFO] Received an event for node: 67406d2911fb139cb87dfb25
11/22/2024 12:57:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2911fb139cb87dfb25
11/22/2024 12:57:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ec511fb139cb87e1971
11/22/2024 12:57:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2911fb139cb87dfb25
11/22/2024 12:57:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e1971
11/22/2024 12:57:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e1972
11/22/2024 12:57:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e1973
11/22/2024 12:57:07 PM UTC [INFO] Received an event for node: 67406e1d11fb139cb87e01b7
11/22/2024 12:57:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1d11fb139cb87e01b7
11/22/2024 12:57:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e197c
11/22/2024 12:57:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e197d
11/22/2024 12:57:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ec511fb139cb87e197e
11/22/2024 12:57:10 PM UTC [INFO] Received an event for node: 67406d1811fb139cb87dfaea
11/22/2024 12:57:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1811fb139cb87dfaea
11/22/2024 12:57:11 PM UTC [INFO] Received an event for node: 67406d5911fb139cb87dfc43
11/22/2024 12:57:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d5911fb139cb87dfc43
11/22/2024 12:57:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5911fb139cb87dfc43
11/22/2024 12:57:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecb11fb139cb87e1986
11/22/2024 12:57:14 PM UTC [INFO] Received an event for node: 67406d1411fb139cb87dfacf
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1411fb139cb87dfacf
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b4
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b6
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b7
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b9
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19bb
11/22/2024 12:57:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19bd
11/22/2024 12:57:18 PM UTC [INFO] Received an event for node: 67406d0311fb139cb87dfa52
11/22/2024 12:58:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0311fb139cb87dfa52
11/22/2024 12:58:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a00
11/22/2024 12:58:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a08
11/22/2024 12:58:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a0a
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0311fb139cb87dfa52
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e198d
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e198e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e198f
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1990
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1991
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1992
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1993
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1994
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1995
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1996
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1997
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1998
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1999
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199a
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199b
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199d
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e199f
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a0
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a1
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a2
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a3
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a4
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a5
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a6
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a7
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a8
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19a9
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19aa
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ab
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ac
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ad
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ae
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19af
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b0
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b2
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b3
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b5
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19b8
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ba
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19bc
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19be
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c1
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c4
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c7
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ca
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19cc
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ce
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d0
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d2
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d5
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d7
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d8
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19da
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19dc
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19de
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e0
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e2
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e4
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e7
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e9
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ea
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ec
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ee
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f1
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f3
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f5
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f7
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f8
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19fb
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19fd
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19fe
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a00
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a06
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a08
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0a
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a10
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a12
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a15
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a17
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a19
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a20
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a22
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a24
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a26
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a28
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2a
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a30
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a32
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a34
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a36
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a38
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3b
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3d
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3f
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a41
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a43
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a45
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a47
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a49
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4b
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4d
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4f
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a51
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a53
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a55
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a57
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a58
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a59
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5e
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a60
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a61
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a64
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a66
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a68
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6a
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6c
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6d
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6f
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a71
11/22/2024 12:58:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a73
11/22/2024 12:58:15 PM UTC [INFO] Received an event for node: 67406cfd11fb139cb87dfa29
11/22/2024 12:58:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cfd11fb139cb87dfa29
11/22/2024 12:58:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aed
11/22/2024 12:58:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aef
11/22/2024 12:58:16 PM UTC [INFO] Received an event for node: 67406d2211fb139cb87dfb0b
11/22/2024 12:58:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2211fb139cb87dfb0b
11/22/2024 12:58:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af8
11/22/2024 12:58:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1afa
11/22/2024 12:58:19 PM UTC [INFO] Received an event for node: 67406df311fb139cb87dff9a
11/22/2024 12:58:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df311fb139cb87dff9a
11/22/2024 12:58:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b03
11/22/2024 12:58:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b06
11/22/2024 12:58:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b08
11/22/2024 12:58:22 PM UTC [INFO] Received an event for node: 67406d0b11fb139cb87dfa88
11/22/2024 01:00:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0b11fb139cb87dfa88
11/22/2024 01:00:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19d6
11/22/2024 01:00:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19d9
11/22/2024 01:00:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19db
11/22/2024 01:00:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19dd
11/22/2024 01:00:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19df
11/22/2024 01:00:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19e1
11/22/2024 01:00:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19e3
11/22/2024 01:00:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19e5
11/22/2024 01:00:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19e6
11/22/2024 01:00:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19e8
11/22/2024 01:00:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19eb
11/22/2024 01:00:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19ed
11/22/2024 01:00:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19ef
11/22/2024 01:00:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19f0
11/22/2024 01:00:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19f2
11/22/2024 01:00:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19f4
11/22/2024 01:00:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19f6
11/22/2024 01:00:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19f9
11/22/2024 01:00:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19fa
11/22/2024 01:00:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19fc
11/22/2024 01:00:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e19ff
11/22/2024 01:00:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a01
11/22/2024 01:00:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a02
11/22/2024 01:00:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a03
11/22/2024 01:00:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a04
11/22/2024 01:00:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a05
11/22/2024 01:00:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a07
11/22/2024 01:00:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a09
11/22/2024 01:00:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a0b
11/22/2024 01:00:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a0d
11/22/2024 01:00:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a0f
11/22/2024 01:00:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a11
11/22/2024 01:00:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a13
11/22/2024 01:00:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a14
11/22/2024 01:00:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a16
11/22/2024 01:00:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a18
11/22/2024 01:00:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a1a
11/22/2024 01:00:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a1b
11/22/2024 01:00:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a1d
11/22/2024 01:00:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a1f
11/22/2024 01:00:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a21
11/22/2024 01:00:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a23
11/22/2024 01:00:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a25
11/22/2024 01:00:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a27
11/22/2024 01:00:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a29
11/22/2024 01:00:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a2b
11/22/2024 01:00:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a2d
11/22/2024 01:00:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a2f
11/22/2024 01:00:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a31
11/22/2024 01:00:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a33
11/22/2024 01:00:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a35
11/22/2024 01:00:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a37
11/22/2024 01:00:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a39
11/22/2024 01:00:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a3a
11/22/2024 01:00:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a3c
11/22/2024 01:00:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a3e
11/22/2024 01:00:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a40
11/22/2024 01:00:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a42
11/22/2024 01:00:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a44
11/22/2024 01:00:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a46
11/22/2024 01:00:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a48
11/22/2024 01:00:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a4a
11/22/2024 01:00:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a4c
11/22/2024 01:00:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a4e
11/22/2024 01:00:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a50
11/22/2024 01:00:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a52
11/22/2024 01:00:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a54
11/22/2024 01:00:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a56
11/22/2024 01:00:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a5a
11/22/2024 01:00:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a5b
11/22/2024 01:00:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a5d
11/22/2024 01:00:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a5f
11/22/2024 01:00:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a62
11/22/2024 01:00:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a63
11/22/2024 01:00:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a65
11/22/2024 01:00:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a67
11/22/2024 01:00:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a69
11/22/2024 01:00:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a6b
11/22/2024 01:00:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a6e
11/22/2024 01:00:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a70
11/22/2024 01:00:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a72
11/22/2024 01:00:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a74
11/22/2024 01:00:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a76
11/22/2024 01:00:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a78
11/22/2024 01:00:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a7a
11/22/2024 01:00:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a7b
11/22/2024 01:00:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a7d
11/22/2024 01:00:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a7e
11/22/2024 01:00:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a7f
11/22/2024 01:00:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a80
11/22/2024 01:00:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a81
11/22/2024 01:00:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a82
11/22/2024 01:00:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a83
11/22/2024 01:00:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a84
11/22/2024 01:00:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a85
11/22/2024 01:00:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a86
11/22/2024 01:00:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a87
11/22/2024 01:00:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a88
11/22/2024 01:00:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a89
11/22/2024 01:00:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8a
11/22/2024 01:00:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8b
11/22/2024 01:00:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8c
11/22/2024 01:00:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8d
11/22/2024 01:00:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8e
11/22/2024 01:00:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a8f
11/22/2024 01:00:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a90
11/22/2024 01:00:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a91
11/22/2024 01:00:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a92
11/22/2024 01:00:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a93
11/22/2024 01:00:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a94
11/22/2024 01:00:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a95
11/22/2024 01:00:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a96
11/22/2024 01:00:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a97
11/22/2024 01:00:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a98
11/22/2024 01:00:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a99
11/22/2024 01:00:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9a
11/22/2024 01:00:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9b
11/22/2024 01:00:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9c
11/22/2024 01:00:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9d
11/22/2024 01:00:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9e
11/22/2024 01:00:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1a9f
11/22/2024 01:00:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa0
11/22/2024 01:00:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa1
11/22/2024 01:00:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa2
11/22/2024 01:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa3
11/22/2024 01:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa4
11/22/2024 01:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa5
11/22/2024 01:00:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa6
11/22/2024 01:01:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa7
11/22/2024 01:01:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa8
11/22/2024 01:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aa9
11/22/2024 01:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aaa
11/22/2024 01:01:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aab
11/22/2024 01:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aac
11/22/2024 01:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aad
11/22/2024 01:01:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aae
11/22/2024 01:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aaf
11/22/2024 01:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab0
11/22/2024 01:01:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab1
11/22/2024 01:01:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab2
11/22/2024 01:01:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab3
11/22/2024 01:01:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab4
11/22/2024 01:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab5
11/22/2024 01:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab6
11/22/2024 01:01:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab7
11/22/2024 01:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab8
11/22/2024 01:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ab9
11/22/2024 01:01:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aba
11/22/2024 01:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1abb
11/22/2024 01:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1abc
11/22/2024 01:01:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1abd
11/22/2024 01:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1abe
11/22/2024 01:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1abf
11/22/2024 01:01:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac0
11/22/2024 01:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac1
11/22/2024 01:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac2
11/22/2024 01:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac3
11/22/2024 01:01:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac4
11/22/2024 01:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac5
11/22/2024 01:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac6
11/22/2024 01:01:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac7
11/22/2024 01:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac8
11/22/2024 01:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ac9
11/22/2024 01:01:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aca
11/22/2024 01:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1acb
11/22/2024 01:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1acc
11/22/2024 01:01:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1acd
11/22/2024 01:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ace
11/22/2024 01:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1acf
11/22/2024 01:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad0
11/22/2024 01:01:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad1
11/22/2024 01:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad2
11/22/2024 01:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad3
11/22/2024 01:01:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad4
11/22/2024 01:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad5
11/22/2024 01:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad6
11/22/2024 01:01:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad7
11/22/2024 01:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad8
11/22/2024 01:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ad9
11/22/2024 01:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ada
11/22/2024 01:01:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1adb
11/22/2024 01:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1adc
11/22/2024 01:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1add
11/22/2024 01:01:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ade
11/22/2024 01:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1adf
11/22/2024 01:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae0
11/22/2024 01:01:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae1
11/22/2024 01:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae2
11/22/2024 01:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae3
11/22/2024 01:01:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae4
11/22/2024 01:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae5
11/22/2024 01:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae6
11/22/2024 01:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae7
11/22/2024 01:01:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae8
11/22/2024 01:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1ae9
11/22/2024 01:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aea
11/22/2024 01:01:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aec
11/22/2024 01:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aee
11/22/2024 01:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1af0
11/22/2024 01:01:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1af3
11/22/2024 01:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1af5
11/22/2024 01:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1af7
11/22/2024 01:01:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1af9
11/22/2024 01:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1afc
11/22/2024 01:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1aff
11/22/2024 01:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b01
11/22/2024 01:01:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b04
11/22/2024 01:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b07
11/22/2024 01:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b09
11/22/2024 01:01:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b0c
11/22/2024 01:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b0e
11/22/2024 01:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b0f
11/22/2024 01:01:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b11
11/22/2024 01:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b12
11/22/2024 01:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b13
11/22/2024 01:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b14
11/22/2024 01:01:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b15
11/22/2024 01:01:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecd11fb139cb87e1b16
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0b11fb139cb87dfa88
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19c9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19cb
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19cd
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19cf
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19d9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19db
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19dd
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19df
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19e8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19eb
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ed
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ef
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19f9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19fa
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19fc
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e19ff
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a01
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a02
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a03
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a04
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a05
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a07
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a09
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a11
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a13
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a14
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a16
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a18
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a1f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a21
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a23
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a25
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a27
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a29
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a2f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a31
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a33
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a35
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a37
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a39
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3c
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a3e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a40
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a42
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a44
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a46
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a48
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4c
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a4e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a50
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a52
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a54
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a56
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a5f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a62
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a63
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a65
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a67
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a69
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a6e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a70
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a72
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a74
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a76
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a78
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a7a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a7b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a7d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a7e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a7f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a80
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a81
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a82
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a83
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a84
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a85
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a86
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a87
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a88
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a89
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8c
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a8f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a90
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a91
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a92
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a93
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a94
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a95
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a96
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a97
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a98
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a99
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9a
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9b
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9c
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9d
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1a9f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aa9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aaa
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aab
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aac
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aad
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aae
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aaf
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ab9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aba
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1abb
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1abc
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1abd
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1abe
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1abf
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ac9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aca
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1acb
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1acc
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1acd
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ace
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1acf
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ad9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ada
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1adb
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1adc
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1add
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ade
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1adf
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae1
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae2
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae4
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae6
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae8
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1ae9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aea
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aec
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aee
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af0
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af3
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af5
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af7
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1af9
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1afc
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1aff
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b01
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b04
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b07
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b09
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b0c
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b0e
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b0f
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b11
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b12
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b13
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b14
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b15
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b16
11/22/2024 01:01:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecd11fb139cb87e1b17
11/22/2024 01:01:28 PM UTC [INFO] Received an event for node: 67406df311fb139cb87dffa0
11/22/2024 01:01:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df311fb139cb87dffa0
11/22/2024 01:01:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b1d
11/22/2024 01:01:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b1e
11/22/2024 01:01:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b1f
11/22/2024 01:01:31 PM UTC [INFO] Received an event for node: 67406d0e11fb139cb87dfa9a
11/22/2024 01:03:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0e11fb139cb87dfa9a
11/22/2024 01:03:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b2e
11/22/2024 01:03:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b2f
11/22/2024 01:03:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b30
11/22/2024 01:03:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b31
11/22/2024 01:03:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b32
11/22/2024 01:03:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b33
11/22/2024 01:03:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b34
11/22/2024 01:03:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b35
11/22/2024 01:03:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b36
11/22/2024 01:03:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b37
11/22/2024 01:03:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b38
11/22/2024 01:03:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b39
11/22/2024 01:03:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3a
11/22/2024 01:03:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3b
11/22/2024 01:03:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3c
11/22/2024 01:03:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3d
11/22/2024 01:03:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3e
11/22/2024 01:03:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b3f
11/22/2024 01:03:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b40
11/22/2024 01:03:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b41
11/22/2024 01:03:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b42
11/22/2024 01:03:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b43
11/22/2024 01:03:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b44
11/22/2024 01:03:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b45
11/22/2024 01:03:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b46
11/22/2024 01:03:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b47
11/22/2024 01:03:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b48
11/22/2024 01:03:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b49
11/22/2024 01:03:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4a
11/22/2024 01:03:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4b
11/22/2024 01:03:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4c
11/22/2024 01:03:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4d
11/22/2024 01:03:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4e
11/22/2024 01:03:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b4f
11/22/2024 01:03:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b50
11/22/2024 01:03:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b51
11/22/2024 01:03:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b52
11/22/2024 01:03:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b53
11/22/2024 01:03:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b54
11/22/2024 01:03:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b55
11/22/2024 01:03:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b56
11/22/2024 01:03:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b57
11/22/2024 01:03:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b58
11/22/2024 01:03:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b59
11/22/2024 01:03:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5a
11/22/2024 01:03:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5b
11/22/2024 01:03:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5c
11/22/2024 01:03:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5d
11/22/2024 01:03:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5e
11/22/2024 01:03:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b5f
11/22/2024 01:03:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b60
11/22/2024 01:03:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b61
11/22/2024 01:03:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b62
11/22/2024 01:03:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b63
11/22/2024 01:03:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b64
11/22/2024 01:03:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b65
11/22/2024 01:03:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b66
11/22/2024 01:03:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b67
11/22/2024 01:03:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b68
11/22/2024 01:03:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b69
11/22/2024 01:03:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6a
11/22/2024 01:03:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6b
11/22/2024 01:03:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6c
11/22/2024 01:03:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6d
11/22/2024 01:03:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6e
11/22/2024 01:03:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b6f
11/22/2024 01:03:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b70
11/22/2024 01:03:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b71
11/22/2024 01:03:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b72
11/22/2024 01:03:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b73
11/22/2024 01:03:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b74
11/22/2024 01:03:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b75
11/22/2024 01:03:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b76
11/22/2024 01:03:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b77
11/22/2024 01:03:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b78
11/22/2024 01:03:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b79
11/22/2024 01:03:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7a
11/22/2024 01:03:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7b
11/22/2024 01:03:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7c
11/22/2024 01:03:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7d
11/22/2024 01:03:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7e
11/22/2024 01:03:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b7f
11/22/2024 01:03:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b80
11/22/2024 01:03:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b81
11/22/2024 01:03:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b82
11/22/2024 01:03:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b83
11/22/2024 01:03:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b84
11/22/2024 01:03:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b85
11/22/2024 01:03:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b86
11/22/2024 01:03:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b87
11/22/2024 01:03:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b88
11/22/2024 01:03:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b89
11/22/2024 01:03:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8a
11/22/2024 01:03:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8b
11/22/2024 01:03:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8c
11/22/2024 01:03:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8d
11/22/2024 01:03:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8e
11/22/2024 01:03:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b8f
11/22/2024 01:03:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b90
11/22/2024 01:03:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b91
11/22/2024 01:03:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b92
11/22/2024 01:03:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b93
11/22/2024 01:03:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b94
11/22/2024 01:03:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b95
11/22/2024 01:03:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b96
11/22/2024 01:03:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b97
11/22/2024 01:03:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b98
11/22/2024 01:03:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b99
11/22/2024 01:03:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9a
11/22/2024 01:03:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9b
11/22/2024 01:03:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9c
11/22/2024 01:03:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9d
11/22/2024 01:03:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9e
11/22/2024 01:03:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1b9f
11/22/2024 01:03:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba0
11/22/2024 01:03:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba1
11/22/2024 01:03:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba2
11/22/2024 01:04:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba3
11/22/2024 01:04:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba4
11/22/2024 01:04:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba5
11/22/2024 01:04:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba6
11/22/2024 01:04:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba7
11/22/2024 01:04:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba8
11/22/2024 01:04:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1ba9
11/22/2024 01:04:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1baa
11/22/2024 01:04:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bab
11/22/2024 01:04:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bac
11/22/2024 01:04:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bad
11/22/2024 01:04:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bae
11/22/2024 01:04:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1baf
11/22/2024 01:04:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb0
11/22/2024 01:04:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb1
11/22/2024 01:04:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb2
11/22/2024 01:04:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb3
11/22/2024 01:04:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb4
11/22/2024 01:04:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb5
11/22/2024 01:04:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb6
11/22/2024 01:04:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb7
11/22/2024 01:04:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb8
11/22/2024 01:04:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bb9
11/22/2024 01:04:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bba
11/22/2024 01:04:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bbb
11/22/2024 01:04:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bbc
11/22/2024 01:04:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bbd
11/22/2024 01:04:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bbe
11/22/2024 01:04:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bbf
11/22/2024 01:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc0
11/22/2024 01:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc1
11/22/2024 01:04:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc2
11/22/2024 01:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc3
11/22/2024 01:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc4
11/22/2024 01:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc5
11/22/2024 01:04:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc6
11/22/2024 01:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc7
11/22/2024 01:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc8
11/22/2024 01:04:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bc9
11/22/2024 01:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bca
11/22/2024 01:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bcb
11/22/2024 01:04:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bcc
11/22/2024 01:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bcd
11/22/2024 01:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bce
11/22/2024 01:04:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bcf
11/22/2024 01:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd0
11/22/2024 01:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd1
11/22/2024 01:04:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd2
11/22/2024 01:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd3
11/22/2024 01:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd4
11/22/2024 01:04:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd5
11/22/2024 01:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd6
11/22/2024 01:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd7
11/22/2024 01:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd8
11/22/2024 01:04:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bd9
11/22/2024 01:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bda
11/22/2024 01:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bdb
11/22/2024 01:04:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bdc
11/22/2024 01:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bdd
11/22/2024 01:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bde
11/22/2024 01:04:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bdf
11/22/2024 01:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be0
11/22/2024 01:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be1
11/22/2024 01:04:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be2
11/22/2024 01:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be3
11/22/2024 01:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be4
11/22/2024 01:04:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be5
11/22/2024 01:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be6
11/22/2024 01:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be7
11/22/2024 01:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be8
11/22/2024 01:04:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1be9
11/22/2024 01:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bea
11/22/2024 01:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1beb
11/22/2024 01:04:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bec
11/22/2024 01:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bed
11/22/2024 01:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bee
11/22/2024 01:04:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bef
11/22/2024 01:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf0
11/22/2024 01:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf1
11/22/2024 01:04:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf2
11/22/2024 01:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf3
11/22/2024 01:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf4
11/22/2024 01:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf5
11/22/2024 01:04:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf6
11/22/2024 01:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf7
11/22/2024 01:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf8
11/22/2024 01:04:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bf9
11/22/2024 01:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bfa
11/22/2024 01:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bfb
11/22/2024 01:04:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bfc
11/22/2024 01:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bfd
11/22/2024 01:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bfe
11/22/2024 01:04:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1bff
11/22/2024 01:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c00
11/22/2024 01:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c01
11/22/2024 01:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c02
11/22/2024 01:04:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c03
11/22/2024 01:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c04
11/22/2024 01:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c05
11/22/2024 01:04:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c06
11/22/2024 01:04:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ece11fb139cb87e1c07
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0e11fb139cb87dfa9a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b25
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b26
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b27
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b28
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b29
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b2f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b30
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b31
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b32
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b33
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b34
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b35
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b36
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b37
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b38
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b39
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b3f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b40
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b41
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b42
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b43
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b44
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b45
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b46
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b47
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b48
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b49
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b4f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b50
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b51
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b52
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b53
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b54
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b55
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b56
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b57
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b58
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b59
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b5f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b60
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b61
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b62
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b63
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b64
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b65
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b66
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b67
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b68
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b69
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b6f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b70
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b71
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b72
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b73
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b74
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b75
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b76
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b77
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b78
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b79
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b7f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b80
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b81
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b82
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b83
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b84
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b85
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b86
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b87
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b88
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b89
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b8f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b90
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b91
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b92
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b93
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b94
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b95
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b96
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b97
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b98
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b99
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9a
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9b
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9c
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9d
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9e
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1b9f
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1ba9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1baa
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bab
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bac
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bad
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bae
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1baf
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bb9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bba
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bbb
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bbc
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bbd
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bbe
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bbf
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bc9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bca
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bcb
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bcc
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bcd
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bce
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bcf
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bd9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bda
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bdb
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bdc
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bdd
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bde
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bdf
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1be9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bea
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1beb
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bec
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bed
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bee
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bef
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf0
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf1
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf2
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf3
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf4
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf5
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf6
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf7
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf8
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bf9
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bfa
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bfb
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bfc
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bfd
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bfe
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1bff
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c00
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c01
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c02
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c03
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c04
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c05
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c06
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c07
11/22/2024 01:04:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ece11fb139cb87e1c08
11/22/2024 01:04:31 PM UTC [INFO] Received an event for node: 67406e2111fb139cb87e02ac
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2111fb139cb87e02ac
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c0e
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c0f
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c10
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c11
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c12
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c13
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c14
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c15
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c16
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c17
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c18
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c19
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1a
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1b
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1c
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1d
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1e
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c1f
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c20
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c21
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c22
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c23
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c24
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c25
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c26
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c27
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c28
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c29
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c2a
11/22/2024 01:04:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecf11fb139cb87e1c2b
11/22/2024 01:04:37 PM UTC [INFO] Received an event for node: 67406d2b11fb139cb87dfb39
11/22/2024 01:04:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.931000] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.938748] Modules linked in:\n[    4.941809] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.949553] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.958251] EIP: __flush_work+0xb8/0xd0\n[    4.962103] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.980851] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    4.987117] ESI: c26aeea8 EDI: c2680000 EBP: c23f1be8 ESP: c23f1b80\n[    4.993385] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.000173] CR0: 80050033 CR2: 00000000 CR3: 1a558000 CR4: 003506d0\n[    5.006441] Call Trace:\n[    5.008894]  ? show_regs+0x51/0x58\n[    5.012302]  ? __flush_work+0xb8/0xd0\n[    5.015971]  ? __warn+0x8d/0x1b8\n[    5.019206]  ? __flush_work+0xb8/0xd0\n[    5.022878]  ? __flush_work+0xb8/0xd0\n[    5.026547]  ? report_bug+0x186/0x1b0\n[    5.030217]  ? __flush_work+0xb9/0xd0\n[    5.033885]  ? exc_overflow+0x50/0x50\n[    5.037555]  ? handle_bug+0x56/0x90\n[    5.041050]  ? exc_invalid_op+0x1d/0x70\n[    5.044891]  ? handle_exception+0x14b/0x14b\n[    5.049083]  ? exc_overflow+0x50/0x50\n[    5.052752]  ? __flush_work+0xb8/0xd0\n[    5.056420]  ? exc_overflow+0x50/0x50\n[    5.060088]  ? __flush_work+0xb8/0xd0\n[    5.063764]  cancel_delayed_work_sync+0x88/0x90\n[    5.068302]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.072838]  ? amdgpu_device_rreg+0x40/0x64\n[    5.077029]  amdgpu_ring_alloc+0x46/0x5c\n[    5.080957]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.086103]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.091595]  amdgpu_ring_test_helper+0x20/0x90\n[    5.096043]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.099884]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.104333]  amdgpu_device_init+0xc4a/0x1458\n[    5.108609]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.112970]  amdgpu_pci_probe+0x153/0x570\n[    5.116986]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.121955]  pci_device_probe+0x8c/0x118\n[    5.125883]  ? sysfs_create_link+0x1d/0x38\n[    5.129987]  really_probe+0xc2/0x2ac\n[    5.133569]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.137936]  ? pm_runtime_barrier+0x52/0x90\n[    5.142133]  __driver_probe_device+0x7a/0x180\n[    5.146494]  ? lock_release+0x6c/0x140\n[    5.150255]  driver_probe_device+0x23/0x108\n[    5.154444]  __driver_attach+0x97/0x188\n[    5.158286]  ? __device_attach_driver+0x120/0x120\n[    5.162994]  bus_for_each_dev+0x71/0xc0\n[    5.166835]  driver_attach+0x19/0x20\n[    5.170421]  ? __device_attach_driver+0x120/0x120\n[    5.175131]  bus_add_driver+0xc9/0x208\n[    5.178886]  driver_register+0x52/0x10c\n[    5.182728]  __pci_register_driver+0x5f/0x68\n[    5.187004]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.191802]  amdgpu_init+0x62/0xb0\n[    5.195210]  do_one_initcall+0x63/0x2a4\n[    5.199051]  ? rdinit_setup+0x40/0x40\n[    5.202719]  ? parse_args+0x14b/0x3f4\n[    5.206393]  do_initcalls+0xdc/0x218\n[    5.209975]  ? rdinit_setup+0x40/0x40\n[    5.213647]  kernel_init_freeable+0x16b/0x2bc\n[    5.218010]  ? kernel_init+0x18/0x1f4\n[    5.221677]  ? rest_init+0x1cc/0x1cc\n[    5.225259]  kernel_init+0x18/0x1f4\n[    5.228752]  ? schedule_tail+0x50/0x60\n[    5.232508]  ret_from_fork+0x38/0x44\n[    5.236089]  ? rest_init+0x1cc/0x1cc\n[    5.239669]  ret_from_fork_asm+0x12/0x18\n[    5.243598]  entry_INT80_32+0x108/0x108\n[    5.247442] irq event stamp: 846607\n[    5.250934] hardirqs last  enabled at (846617): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    5.258938] hardirqs last disabled at (846626): [<d6e09055>] __up_console_sem+0x39/0x58\n[    5.266939] softirqs last  enabled at (846514): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    5.275033] softirqs last disabled at (846645): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.516909] WARNING: CPU: 2 PID: 48 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.524761] Modules linked in:\n[    8.527830] CPU: 2 UID: 0 PID: 48 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.537317] Tainted: [W]=WARN\n[    8.540303] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    8.549008] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.555464] EIP: __flush_work+0xb8/0xd0\n[    8.559317] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.578078] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    8.584357] ESI: c26aeea8 EDI: c27ba17c EBP: c19edd64 ESP: c19edcfc\n[    8.590633] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.597430] CR0: 80050033 CR2: b7e38680 CR3: 1a558000 CR4: 003506d0\n[    8.603705] Call Trace:\n[    8.606169]  ? show_regs+0x51/0x58\n[    8.609589]  ? __flush_work+0xb8/0xd0\n[    8.613267]  ? __warn+0x8d/0x1b8\n[    8.616511]  ? __flush_work+0xb8/0xd0\n[    8.620190]  ? __flush_work+0xb8/0xd0\n[    8.623864]  ? report_bug+0x186/0x1b0\n[    8.627546]  ? __flush_work+0xb9/0xd0\n[    8.631222]  ? exc_overflow+0x50/0x50\n[    8.634900]  ? handle_bug+0x56/0x90\n[    8.638409]  ? exc_invalid_op+0x1d/0x70\n[    8.642264]  ? handle_exception+0x14b/0x14b\n[    8.646467]  ? exc_overflow+0x50/0x50\n[    8.650153]  ? __flush_work+0xb8/0xd0\n[    8.653832]  ? exc_overflow+0x50/0x50\n[    8.657512]  ? __flush_work+0xb8/0xd0\n[    8.661194]  cancel_delayed_work_sync+0x88/0x90\n[    8.665740]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.670293]  amdgpu_ring_alloc+0x46/0x5c\n[    8.674236]  amdgpu_ib_schedule+0x14b/0x898\n[    8.678441]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.682999]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.688587]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.693568]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.698980]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.703359]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.709210]  process_one_work+0x1b9/0x6f0\n[    8.713238]  ? process_one_work+0x16c/0x6f0\n[    8.717442]  worker_thread+0x168/0x304\n[    8.721209]  kthread+0xcc/0xf4\n[    8.724278]  ? rescuer_thread+0x33c/0x33c\n[    8.728302]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.733715]  ret_from_fork+0x38/0x44\n[    8.737310]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.742723]  ret_from_fork_asm+0x12/0x18\n[    8.746660]  entry_INT80_32+0x108/0x108\n[    8.750515] irq event stamp: 22323\n[    8.753933] hardirqs last  enabled at (22357): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    8.761863] hardirqs last disabled at (22390): [<d6e09055>] __up_console_sem+0x39/0x58\n[    8.769790] softirqs last  enabled at (22422): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    8.777804] softirqs last disabled at (22435): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df8d7661295be7f290db5f8dd5360c49758a5b37', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57ff41ebb22c42abc22133d0651cd37fa62b5a6a', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:04:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.931000] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.938748] Modules linked in:\n[    4.941809] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.949553] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.958251] EIP: __flush_work+0xb8/0xd0\n[    4.962103] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.980851] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    4.987117] ESI: c26aeea8 EDI: c2680000 EBP: c23f1be8 ESP: c23f1b80\n[    4.993385] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.000173] CR0: 80050033 CR2: 00000000 CR3: 1a558000 CR4: 003506d0\n[    5.006441] Call Trace:\n[    5.008894]  ? show_regs+0x51/0x58\n[    5.012302]  ? __flush_work+0xb8/0xd0\n[    5.015971]  ? __warn+0x8d/0x1b8\n[    5.019206]  ? __flush_work+0xb8/0xd0\n[    5.022878]  ? __flush_work+0xb8/0xd0\n[    5.026547]  ? report_bug+0x186/0x1b0\n[    5.030217]  ? __flush_work+0xb9/0xd0\n[    5.033885]  ? exc_overflow+0x50/0x50\n[    5.037555]  ? handle_bug+0x56/0x90\n[    5.041050]  ? exc_invalid_op+0x1d/0x70\n[    5.044891]  ? handle_exception+0x14b/0x14b\n[    5.049083]  ? exc_overflow+0x50/0x50\n[    5.052752]  ? __flush_work+0xb8/0xd0\n[    5.056420]  ? exc_overflow+0x50/0x50\n[    5.060088]  ? __flush_work+0xb8/0xd0\n[    5.063764]  cancel_delayed_work_sync+0x88/0x90\n[    5.068302]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.072838]  ? amdgpu_device_rreg+0x40/0x64\n[    5.077029]  amdgpu_ring_alloc+0x46/0x5c\n[    5.080957]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.086103]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.091595]  amdgpu_ring_test_helper+0x20/0x90\n[    5.096043]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.099884]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.104333]  amdgpu_device_init+0xc4a/0x1458\n[    5.108609]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.112970]  amdgpu_pci_probe+0x153/0x570\n[    5.116986]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.121955]  pci_device_probe+0x8c/0x118\n[    5.125883]  ? sysfs_create_link+0x1d/0x38\n[    5.129987]  really_probe+0xc2/0x2ac\n[    5.133569]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.137936]  ? pm_runtime_barrier+0x52/0x90\n[    5.142133]  __driver_probe_device+0x7a/0x180\n[    5.146494]  ? lock_release+0x6c/0x140\n[    5.150255]  driver_probe_device+0x23/0x108\n[    5.154444]  __driver_attach+0x97/0x188\n[    5.158286]  ? __device_attach_driver+0x120/0x120\n[    5.162994]  bus_for_each_dev+0x71/0xc0\n[    5.166835]  driver_attach+0x19/0x20\n[    5.170421]  ? __device_attach_driver+0x120/0x120\n[    5.175131]  bus_add_driver+0xc9/0x208\n[    5.178886]  driver_register+0x52/0x10c\n[    5.182728]  __pci_register_driver+0x5f/0x68\n[    5.187004]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.191802]  amdgpu_init+0x62/0xb0\n[    5.195210]  do_one_initcall+0x63/0x2a4\n[    5.199051]  ? rdinit_setup+0x40/0x40\n[    5.202719]  ? parse_args+0x14b/0x3f4\n[    5.206393]  do_initcalls+0xdc/0x218\n[    5.209975]  ? rdinit_setup+0x40/0x40\n[    5.213647]  kernel_init_freeable+0x16b/0x2bc\n[    5.218010]  ? kernel_init+0x18/0x1f4\n[    5.221677]  ? rest_init+0x1cc/0x1cc\n[    5.225259]  kernel_init+0x18/0x1f4\n[    5.228752]  ? schedule_tail+0x50/0x60\n[    5.232508]  ret_from_fork+0x38/0x44\n[    5.236089]  ? rest_init+0x1cc/0x1cc\n[    5.239669]  ret_from_fork_asm+0x12/0x18\n[    5.243598]  entry_INT80_32+0x108/0x108\n[    5.247442] irq event stamp: 846607\n[    5.250934] hardirqs last  enabled at (846617): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    5.258938] hardirqs last disabled at (846626): [<d6e09055>] __up_console_sem+0x39/0x58\n[    5.266939] softirqs last  enabled at (846514): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    5.275033] softirqs last disabled at (846645): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.516909] WARNING: CPU: 2 PID: 48 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.524761] Modules linked in:\n[    8.527830] CPU: 2 UID: 0 PID: 48 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.537317] Tainted: [W]=WARN\n[    8.540303] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    8.549008] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.555464] EIP: __flush_work+0xb8/0xd0\n[    8.559317] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.578078] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    8.584357] ESI: c26aeea8 EDI: c27ba17c EBP: c19edd64 ESP: c19edcfc\n[    8.590633] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.597430] CR0: 80050033 CR2: b7e38680 CR3: 1a558000 CR4: 003506d0\n[    8.603705] Call Trace:\n[    8.606169]  ? show_regs+0x51/0x58\n[    8.609589]  ? __flush_work+0xb8/0xd0\n[    8.613267]  ? __warn+0x8d/0x1b8\n[    8.616511]  ? __flush_work+0xb8/0xd0\n[    8.620190]  ? __flush_work+0xb8/0xd0\n[    8.623864]  ? report_bug+0x186/0x1b0\n[    8.627546]  ? __flush_work+0xb9/0xd0\n[    8.631222]  ? exc_overflow+0x50/0x50\n[    8.634900]  ? handle_bug+0x56/0x90\n[    8.638409]  ? exc_invalid_op+0x1d/0x70\n[    8.642264]  ? handle_exception+0x14b/0x14b\n[    8.646467]  ? exc_overflow+0x50/0x50\n[    8.650153]  ? __flush_work+0xb8/0xd0\n[    8.653832]  ? exc_overflow+0x50/0x50\n[    8.657512]  ? __flush_work+0xb8/0xd0\n[    8.661194]  cancel_delayed_work_sync+0x88/0x90\n[    8.665740]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.670293]  amdgpu_ring_alloc+0x46/0x5c\n[    8.674236]  amdgpu_ib_schedule+0x14b/0x898\n[    8.678441]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.682999]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.688587]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.693568]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.698980]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.703359]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.709210]  process_one_work+0x1b9/0x6f0\n[    8.713238]  ? process_one_work+0x16c/0x6f0\n[    8.717442]  worker_thread+0x168/0x304\n[    8.721209]  kthread+0xcc/0xf4\n[    8.724278]  ? rescuer_thread+0x33c/0x33c\n[    8.728302]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.733715]  ret_from_fork+0x38/0x44\n[    8.737310]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.742723]  ret_from_fork_asm+0x12/0x18\n[    8.746660]  entry_INT80_32+0x108/0x108\n[    8.750515] irq event stamp: 22323\n[    8.753933] hardirqs last  enabled at (22357): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    8.761863] hardirqs last disabled at (22390): [<d6e09055>] __up_console_sem+0x39/0x58\n[    8.769790] softirqs last  enabled at (22422): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    8.777804] softirqs last disabled at (22435): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:05d7dd78f9b53368c3b172a5e8ffb2c841d9452e', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1c74a3e6ec816e721b5225d1afd7402794c8309f', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2b11fb139cb87dfb39
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ed311fb139cb87e1c31
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ed311fb139cb87e1c32
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ed311fb139cb87e1c33
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df8d7661295be7f290db5f8dd5360c49758a5b37
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57ff41ebb22c42abc22133d0651cd37fa62b5a6a
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05d7dd78f9b53368c3b172a5e8ffb2c841d9452e
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b
11/22/2024 01:04:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c74a3e6ec816e721b5225d1afd7402794c8309f
11/22/2024 01:04:41 PM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa6d
11/22/2024 01:05:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:36e8bad841b4628f2be18846593a50467ab6f5be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:36e8bad841b4628f2be18846593a50467ab6f5be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:05:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d21b6b65a4465c1c34a436de4036854a609f8d45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d21b6b65a4465c1c34a436de4036854a609f8d45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:05:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:05:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa6d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c39
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c3f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c40
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c41
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c42
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c43
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c44
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c45
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c46
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c47
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c48
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c49
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c4f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c50
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c51
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c52
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c53
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c54
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c55
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c56
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c57
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c58
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c59
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c5f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c60
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c61
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c62
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c63
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c64
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c65
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c66
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c67
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c68
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c69
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c6f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c70
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c71
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c72
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c73
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c74
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c75
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c76
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c77
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c78
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c79
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c7f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c80
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c81
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c82
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c83
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c84
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c85
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c86
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c87
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c88
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c89
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c8f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c90
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c91
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c92
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c93
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c94
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c95
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c96
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c97
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c98
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c99
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9b
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9c
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9d
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9e
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c9f
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca0
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca1
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca2
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca3
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca4
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca5
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca6
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca7
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca8
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1ca9
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1caa
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cab
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cac
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cad
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cae
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1caf
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb0
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb1
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb2
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb3
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb4
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb5
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb6
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb7
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb8
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1cb9
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36e8bad841b4628f2be18846593a50467ab6f5be
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36e8bad841b4628f2be18846593a50467ab6f5be
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d21b6b65a4465c1c34a436de4036854a609f8d45
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d21b6b65a4465c1c34a436de4036854a609f8d45
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776
11/22/2024 01:05:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776
11/22/2024 01:05:39 PM UTC [INFO] Received an event for node: 67406e8411fb139cb87e0fb7
11/22/2024 01:05:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8411fb139cb87e0fb7
11/22/2024 01:05:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee911fb139cb87e1cbf
11/22/2024 01:05:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee911fb139cb87e1cc0
11/22/2024 01:05:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee911fb139cb87e1cc1
11/22/2024 01:05:41 PM UTC [INFO] Received an event for node: 67406e8211fb139cb87e0fae
11/22/2024 01:05:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8211fb139cb87e0fae
11/22/2024 01:05:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eef11fb139cb87e1cc7
11/22/2024 01:05:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eef11fb139cb87e1cc8
11/22/2024 01:05:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406eef11fb139cb87e1cc9
11/22/2024 01:05:44 PM UTC [INFO] Received an event for node: 67406d2211fb139cb87dfb0e
11/22/2024 01:05:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2211fb139cb87dfb0e
11/22/2024 01:05:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ef111fb139cb87e1ccf
11/22/2024 01:05:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ef111fb139cb87e1cd0
11/22/2024 01:05:46 PM UTC [INFO] Received an event for node: 67406e8511fb139cb87e0fbd
11/22/2024 01:05:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8511fb139cb87e0fbd
11/22/2024 01:05:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ef611fb139cb87e1cd6
11/22/2024 01:05:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ef611fb139cb87e1cd7
11/22/2024 01:05:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ef611fb139cb87e1cd8
11/22/2024 01:05:49 PM UTC [INFO] Received an event for node: 67406e1811fb139cb87e01a3
11/22/2024 01:05:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1811fb139cb87e01a3
11/22/2024 01:05:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406efd11fb139cb87e1cde
11/22/2024 01:05:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406efd11fb139cb87e1cdf
11/22/2024 01:05:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406efd11fb139cb87e1ce0
11/22/2024 01:05:51 PM UTC [INFO] Received an event for node: 67406e8311fb139cb87e0fb4
11/22/2024 01:05:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8311fb139cb87e0fb4
11/22/2024 01:05:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0011fb139cb87e1ce6
11/22/2024 01:05:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0011fb139cb87e1ce7
11/22/2024 01:05:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0011fb139cb87e1ce8
11/22/2024 01:05:54 PM UTC [INFO] Received an event for node: 67406e8511fb139cb87e0fc0
11/22/2024 01:05:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8511fb139cb87e0fc0
11/22/2024 01:05:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cee
11/22/2024 01:05:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cef
11/22/2024 01:05:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cf0
11/22/2024 01:05:57 PM UTC [INFO] Received an event for node: 67406e8711fb139cb87e0fc9
11/22/2024 01:05:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8711fb139cb87e0fc9
11/22/2024 01:05:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cf6
11/22/2024 01:05:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cf7
11/22/2024 01:05:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0411fb139cb87e1cf8
11/22/2024 01:05:59 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0fa4
11/22/2024 01:06:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0fa4
11/22/2024 01:06:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0d11fb139cb87e1cfe
11/22/2024 01:06:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0d11fb139cb87e1cff
11/22/2024 01:06:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f0d11fb139cb87e1d00
11/22/2024 01:06:02 PM UTC [INFO] Received an event for node: 67406e8411fb139cb87e0fba
11/22/2024 01:06:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8411fb139cb87e0fba
11/22/2024 01:06:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1611fb139cb87e1d06
11/22/2024 01:06:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1611fb139cb87e1d07
11/22/2024 01:06:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1611fb139cb87e1d08
11/22/2024 01:06:04 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0f1b
11/22/2024 01:06:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f1b
11/22/2024 01:06:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1711fb139cb87e1d0e
11/22/2024 01:06:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1711fb139cb87e1d0f
11/22/2024 01:06:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1711fb139cb87e1d10
11/22/2024 01:06:07 PM UTC [INFO] Received an event for node: 67406e8211fb139cb87e0fb1
11/22/2024 01:06:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8211fb139cb87e0fb1
11/22/2024 01:06:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1f11fb139cb87e1d16
11/22/2024 01:06:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1f11fb139cb87e1d17
11/22/2024 01:06:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f1f11fb139cb87e1d18
11/22/2024 01:06:10 PM UTC [INFO] Received an event for node: 67406d1911fb139cb87dfaf0
11/22/2024 01:06:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1911fb139cb87dfaf0
11/22/2024 01:06:11 PM UTC [INFO] Received an event for node: 67406d0d11fb139cb87dfa94
11/22/2024 01:08:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0d11fb139cb87dfa94
11/22/2024 01:08:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d2b
11/22/2024 01:08:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d2c
11/22/2024 01:08:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d2d
11/22/2024 01:08:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d2e
11/22/2024 01:08:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d2f
11/22/2024 01:08:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d30
11/22/2024 01:08:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d31
11/22/2024 01:08:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d32
11/22/2024 01:08:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d33
11/22/2024 01:08:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d34
11/22/2024 01:08:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d35
11/22/2024 01:08:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d36
11/22/2024 01:08:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d37
11/22/2024 01:08:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d38
11/22/2024 01:08:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d39
11/22/2024 01:08:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3a
11/22/2024 01:08:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3b
11/22/2024 01:08:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3c
11/22/2024 01:08:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3d
11/22/2024 01:08:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3e
11/22/2024 01:08:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d3f
11/22/2024 01:08:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d40
11/22/2024 01:08:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d41
11/22/2024 01:08:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d42
11/22/2024 01:08:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d43
11/22/2024 01:08:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d44
11/22/2024 01:08:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d45
11/22/2024 01:08:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d46
11/22/2024 01:08:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d47
11/22/2024 01:08:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d48
11/22/2024 01:08:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d49
11/22/2024 01:08:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4a
11/22/2024 01:08:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4b
11/22/2024 01:08:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4c
11/22/2024 01:08:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4d
11/22/2024 01:08:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4e
11/22/2024 01:08:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d4f
11/22/2024 01:08:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d50
11/22/2024 01:08:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d51
11/22/2024 01:08:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d52
11/22/2024 01:08:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d53
11/22/2024 01:08:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d54
11/22/2024 01:08:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d55
11/22/2024 01:08:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d56
11/22/2024 01:08:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d57
11/22/2024 01:08:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d58
11/22/2024 01:08:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d59
11/22/2024 01:08:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5a
11/22/2024 01:08:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5b
11/22/2024 01:08:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5c
11/22/2024 01:08:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5d
11/22/2024 01:08:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5e
11/22/2024 01:08:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d5f
11/22/2024 01:08:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d60
11/22/2024 01:08:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d61
11/22/2024 01:08:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d62
11/22/2024 01:08:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d63
11/22/2024 01:08:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d64
11/22/2024 01:08:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d65
11/22/2024 01:08:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d66
11/22/2024 01:08:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d67
11/22/2024 01:08:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d68
11/22/2024 01:08:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d69
11/22/2024 01:08:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6a
11/22/2024 01:08:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6b
11/22/2024 01:08:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6c
11/22/2024 01:08:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6d
11/22/2024 01:08:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6e
11/22/2024 01:08:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d6f
11/22/2024 01:08:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d70
11/22/2024 01:08:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d71
11/22/2024 01:08:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d72
11/22/2024 01:08:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d73
11/22/2024 01:08:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d74
11/22/2024 01:08:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d75
11/22/2024 01:08:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d76
11/22/2024 01:08:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d77
11/22/2024 01:08:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d78
11/22/2024 01:08:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d79
11/22/2024 01:08:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7a
11/22/2024 01:08:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7b
11/22/2024 01:08:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7c
11/22/2024 01:08:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7d
11/22/2024 01:08:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7e
11/22/2024 01:08:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d7f
11/22/2024 01:08:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d80
11/22/2024 01:08:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d81
11/22/2024 01:08:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d82
11/22/2024 01:08:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d83
11/22/2024 01:08:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d84
11/22/2024 01:08:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d85
11/22/2024 01:08:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d86
11/22/2024 01:08:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d87
11/22/2024 01:08:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d88
11/22/2024 01:08:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d89
11/22/2024 01:08:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8a
11/22/2024 01:08:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8b
11/22/2024 01:08:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8c
11/22/2024 01:08:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8d
11/22/2024 01:08:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8e
11/22/2024 01:08:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d8f
11/22/2024 01:08:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d90
11/22/2024 01:08:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d91
11/22/2024 01:08:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d92
11/22/2024 01:08:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d93
11/22/2024 01:08:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d94
11/22/2024 01:08:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d95
11/22/2024 01:08:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d96
11/22/2024 01:08:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d97
11/22/2024 01:08:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d98
11/22/2024 01:08:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d99
11/22/2024 01:08:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9a
11/22/2024 01:08:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9b
11/22/2024 01:08:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9c
11/22/2024 01:08:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9d
11/22/2024 01:08:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9e
11/22/2024 01:08:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1d9f
11/22/2024 01:08:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da0
11/22/2024 01:08:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da1
11/22/2024 01:08:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da2
11/22/2024 01:08:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da3
11/22/2024 01:08:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da4
11/22/2024 01:08:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da5
11/22/2024 01:08:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da6
11/22/2024 01:08:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da7
11/22/2024 01:08:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da8
11/22/2024 01:08:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1da9
11/22/2024 01:08:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1daa
11/22/2024 01:08:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dab
11/22/2024 01:08:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dac
11/22/2024 01:08:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dad
11/22/2024 01:08:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dae
11/22/2024 01:08:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1daf
11/22/2024 01:08:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db0
11/22/2024 01:08:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db1
11/22/2024 01:08:45 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db2
11/22/2024 01:08:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db3
11/22/2024 01:08:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db4
11/22/2024 01:08:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db5
11/22/2024 01:08:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db6
11/22/2024 01:08:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db7
11/22/2024 01:08:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db8
11/22/2024 01:08:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1db9
11/22/2024 01:08:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dba
11/22/2024 01:08:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dbb
11/22/2024 01:08:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3811fb139cb87e1dbc
11/22/2024 01:08:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dbd
11/22/2024 01:08:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dbe
11/22/2024 01:08:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dbf
11/22/2024 01:08:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc0
11/22/2024 01:08:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc1
11/22/2024 01:08:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc2
11/22/2024 01:08:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc3
11/22/2024 01:08:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc4
11/22/2024 01:08:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc5
11/22/2024 01:08:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc6
11/22/2024 01:08:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc7
11/22/2024 01:08:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc8
11/22/2024 01:08:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dc9
11/22/2024 01:08:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dca
11/22/2024 01:08:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dcb
11/22/2024 01:08:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dcc
11/22/2024 01:08:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dcd
11/22/2024 01:08:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dce
11/22/2024 01:08:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dcf
11/22/2024 01:08:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd0
11/22/2024 01:08:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd1
11/22/2024 01:08:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd2
11/22/2024 01:08:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd3
11/22/2024 01:08:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd4
11/22/2024 01:08:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd5
11/22/2024 01:08:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd6
11/22/2024 01:08:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd7
11/22/2024 01:08:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd8
11/22/2024 01:08:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dd9
11/22/2024 01:08:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dda
11/22/2024 01:08:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1ddb
11/22/2024 01:08:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1ddc
11/22/2024 01:08:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1ddd
11/22/2024 01:08:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dde
11/22/2024 01:08:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1ddf
11/22/2024 01:09:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de0
11/22/2024 01:09:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de1
11/22/2024 01:09:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de2
11/22/2024 01:09:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de3
11/22/2024 01:09:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de4
11/22/2024 01:09:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de5
11/22/2024 01:09:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de6
11/22/2024 01:09:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de7
11/22/2024 01:09:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de8
11/22/2024 01:09:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1de9
11/22/2024 01:09:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dea
11/22/2024 01:09:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1deb
11/22/2024 01:09:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dec
11/22/2024 01:09:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1ded
11/22/2024 01:09:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dee
11/22/2024 01:09:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1def
11/22/2024 01:09:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df0
11/22/2024 01:09:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df1
11/22/2024 01:09:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df2
11/22/2024 01:09:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df3
11/22/2024 01:09:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df4
11/22/2024 01:09:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df5
11/22/2024 01:09:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df6
11/22/2024 01:09:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df7
11/22/2024 01:09:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df8
11/22/2024 01:09:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1df9
11/22/2024 01:09:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dfa
11/22/2024 01:09:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dfb
11/22/2024 01:09:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dfc
11/22/2024 01:09:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dfd
11/22/2024 01:09:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dfe
11/22/2024 01:09:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1dff
11/22/2024 01:09:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1e00
11/22/2024 01:09:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1e01
11/22/2024 01:09:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1e02
11/22/2024 01:09:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1e03
11/22/2024 01:09:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f3911fb139cb87e1e04
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0d11fb139cb87dfa94
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d22
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d23
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d24
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d25
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d26
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d27
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d28
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d29
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d2f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d30
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d31
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d32
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d33
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d34
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d35
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d36
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d37
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d38
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d39
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d3f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d40
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d41
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d42
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d43
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d44
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d45
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d46
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d47
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d48
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d49
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d4f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d50
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d51
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d52
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d53
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d54
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d55
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d56
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d57
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d58
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d59
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d5f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d60
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d61
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d62
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d63
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d64
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d65
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d66
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d67
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d68
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d69
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d6f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d70
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d71
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d72
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d73
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d74
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d75
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d76
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d77
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d78
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d79
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d7f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d80
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d81
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d82
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d83
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d84
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d85
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d86
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d87
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d88
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d89
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d8f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d90
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d91
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d92
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d93
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d94
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d95
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d96
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d97
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d98
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d99
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9a
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9b
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9c
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9d
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9e
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1d9f
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1da9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1daa
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dab
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dac
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dad
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dae
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1daf
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1db9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dba
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dbb
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3811fb139cb87e1dbc
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dbd
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dbe
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dbf
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dc9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dca
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dcb
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dcc
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dcd
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dce
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dcf
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dd9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dda
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1ddb
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1ddc
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1ddd
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dde
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1ddf
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1de9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dea
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1deb
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dec
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1ded
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dee
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1def
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df0
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df1
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df2
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df3
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df4
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df5
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df6
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df7
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df8
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1df9
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dfa
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dfb
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dfc
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dfd
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dfe
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1dff
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e00
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e01
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e02
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e03
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e04
11/22/2024 01:09:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f3911fb139cb87e1e05
11/22/2024 01:09:11 PM UTC [INFO] Received an event for node: 67406df611fb139cb87dffb6
11/22/2024 01:09:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.560944] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.568863] Modules linked in:\n[    4.571922] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.583216] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.591908] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.596355] Code: 48 8b 15 c4 43 f0 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.615100] RSP: 0018:ffffbd4e80033b60 EFLAGS: 00010246\n[    4.620326] RAX: 0000000000000000 RBX: ffffa078c6dbbd08 RCX: 0000000000000000\n[    4.627458] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd4e80033bc0\n[    4.634590] RBP: ffffa078c6dbbd08 R08: ffffa078c6db1fa0 R09: ffffa078c70da000\n[    4.641724] R10: 0000000000000040 R11: ffffffffa272fd88 R12: ffffa078c6d80000\n[    4.648856] R13: ffffa078c6db4fe0 R14: ffffbd4e80033b68 R15: 0000000000000001\n[    4.655987] FS:  0000000000000000(0000) GS:ffffa078eaf80000(0000) knlGS:0000000000000000\n[    4.664070] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.669814] CR2: 0000000000000000 CR3: 000000002a428000 CR4: 00000000003506f0\n[    4.676945] Call Trace:\n[    4.679395]  <TASK>\n[    4.681499]  ? __warn+0x85/0x130\n[    4.684733]  ? __flush_work+0x29f/0x2c0\n[    4.688573]  ? report_bug+0x160/0x190\n[    4.692242]  ? handle_bug+0x53/0x90\n[    4.695737]  ? exc_invalid_op+0x13/0x60\n[    4.699575]  ? asm_exc_invalid_op+0x16/0x20\n[    4.703764]  ? __flush_work+0x29f/0x2c0\n[    4.707606]  cancel_delayed_work_sync+0x6e/0x90\n[    4.712138]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.716673]  amdgpu_ring_alloc+0x3f/0x60\n[    4.720599]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.725739]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.730184]  amdgpu_device_init+0x205f/0x26f0\n[    4.734544]  amdgpu_driver_load_kms+0x15/0x80\n[    4.738906]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.742920]  pci_device_probe+0x98/0x120\n[    4.746850]  really_probe+0xd1/0x2b0\n[    4.750432]  ? __device_attach_driver+0xc0/0xc0\n[    4.754963]  __driver_probe_device+0x73/0x120\n[    4.759322]  driver_probe_device+0x1f/0x90\n[    4.763421]  __driver_attach+0x84/0x130\n[    4.767261]  bus_for_each_dev+0x84/0xd0\n[    4.771100]  bus_add_driver+0xe4/0x210\n[    4.774853]  driver_register+0x55/0x100\n[    4.778691]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.783476]  do_one_initcall+0x57/0x300\n[    4.787316]  kernel_init_freeable+0x1be/0x300\n[    4.791677]  ? rest_init+0xc0/0xc0\n[    4.795082]  kernel_init+0x16/0x1b0\n[    4.798576]  ret_from_fork+0x30/0x50\n[    4.802156]  ? rest_init+0xc0/0xc0\n[    4.805562]  ret_from_fork_asm+0x11/0x20\n[    4.809490]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.006330] WARNING: CPU: 3 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.014332] Modules linked in:\n[    5.017392] CPU: 3 UID: 0 PID: 57 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.030422] Tainted: [W]=WARN\n[    5.033391] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    5.042085] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.048529] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.052979] Code: 48 8b 15 c4 43 f0 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.071724] RSP: 0018:ffffbd4e8029bc58 EFLAGS: 00010246\n[    5.076951] RAX: 0000000000000000 RBX: ffffa078c6dbbd08 RCX: 0000000000000000\n[    5.084082] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd4e8029bcb8\n[    5.091215] RBP: ffffa078c6dbbd08 R08: ffffbd4e8029bde8 R09: 0000000000000000\n[    5.098347] R10: ffffbd4e8029bb30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.105481] R13: ffffa078c6db4fe0 R14: ffffbd4e8029bc60 R15: 0000000000000001\n[    5.112615] FS:  0000000000000000(0000) GS:ffffa078eaf80000(0000) knlGS:0000000000000000\n[    5.120702] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.126446] CR2: 0000000000000000 CR3: 000000002a428000 CR4: 00000000003506f0\n[    5.133580] Call Trace:\n[    5.136032]  <TASK>\n[    5.138136]  ? __warn+0x85/0x130\n[    5.141373]  ? __flush_work+0x29f/0x2c0\n[    5.145214]  ? report_bug+0x160/0x190\n[    5.148882]  ? handle_bug+0x53/0x90\n[    5.152379]  ? exc_invalid_op+0x13/0x60\n[    5.156220]  ? asm_exc_invalid_op+0x16/0x20\n[    5.160411]  ? __flush_work+0x29f/0x2c0\n[    5.164253]  cancel_delayed_work_sync+0x6e/0x90\n[    5.168789]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.173325]  amdgpu_ring_alloc+0x3f/0x60\n[    5.177255]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.181359]  amdgpu_job_submit_direct+0x30/0x50\n[    5.185895]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.190862]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.195222]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.201056]  process_one_work+0x18b/0x3d0\n[    5.205072]  worker_thread+0x2e4/0x420\n[    5.208827]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.213709]  ? rescuer_thread+0x5d0/0x5d0\n[    5.217722]  kthread+0xdf/0x110\n[    5.220869]  ? kthread_park+0x90/0x90\n[    5.224536]  ret_from_fork+0x30/0x50\n[    5.228116]  ? kthread_park+0x90/0x90\n[    5.231781]  ret_from_fork_asm+0x11/0x20\n[    5.235711]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a5238d616fac141aad22b206dc7ee9807255fe9f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df611fb139cb87dffb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5238d616fac141aad22b206dc7ee9807255fe9f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df611fb139cb87dffb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:09:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.560944] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.568863] Modules linked in:\n[    4.571922] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.583216] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.591908] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.596355] Code: 48 8b 15 c4 43 f0 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.615100] RSP: 0018:ffffbd4e80033b60 EFLAGS: 00010246\n[    4.620326] RAX: 0000000000000000 RBX: ffffa078c6dbbd08 RCX: 0000000000000000\n[    4.627458] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd4e80033bc0\n[    4.634590] RBP: ffffa078c6dbbd08 R08: ffffa078c6db1fa0 R09: ffffa078c70da000\n[    4.641724] R10: 0000000000000040 R11: ffffffffa272fd88 R12: ffffa078c6d80000\n[    4.648856] R13: ffffa078c6db4fe0 R14: ffffbd4e80033b68 R15: 0000000000000001\n[    4.655987] FS:  0000000000000000(0000) GS:ffffa078eaf80000(0000) knlGS:0000000000000000\n[    4.664070] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.669814] CR2: 0000000000000000 CR3: 000000002a428000 CR4: 00000000003506f0\n[    4.676945] Call Trace:\n[    4.679395]  <TASK>\n[    4.681499]  ? __warn+0x85/0x130\n[    4.684733]  ? __flush_work+0x29f/0x2c0\n[    4.688573]  ? report_bug+0x160/0x190\n[    4.692242]  ? handle_bug+0x53/0x90\n[    4.695737]  ? exc_invalid_op+0x13/0x60\n[    4.699575]  ? asm_exc_invalid_op+0x16/0x20\n[    4.703764]  ? __flush_work+0x29f/0x2c0\n[    4.707606]  cancel_delayed_work_sync+0x6e/0x90\n[    4.712138]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.716673]  amdgpu_ring_alloc+0x3f/0x60\n[    4.720599]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.725739]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.730184]  amdgpu_device_init+0x205f/0x26f0\n[    4.734544]  amdgpu_driver_load_kms+0x15/0x80\n[    4.738906]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.742920]  pci_device_probe+0x98/0x120\n[    4.746850]  really_probe+0xd1/0x2b0\n[    4.750432]  ? __device_attach_driver+0xc0/0xc0\n[    4.754963]  __driver_probe_device+0x73/0x120\n[    4.759322]  driver_probe_device+0x1f/0x90\n[    4.763421]  __driver_attach+0x84/0x130\n[    4.767261]  bus_for_each_dev+0x84/0xd0\n[    4.771100]  bus_add_driver+0xe4/0x210\n[    4.774853]  driver_register+0x55/0x100\n[    4.778691]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.783476]  do_one_initcall+0x57/0x300\n[    4.787316]  kernel_init_freeable+0x1be/0x300\n[    4.791677]  ? rest_init+0xc0/0xc0\n[    4.795082]  kernel_init+0x16/0x1b0\n[    4.798576]  ret_from_fork+0x30/0x50\n[    4.802156]  ? rest_init+0xc0/0xc0\n[    4.805562]  ret_from_fork_asm+0x11/0x20\n[    4.809490]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.006330] WARNING: CPU: 3 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.014332] Modules linked in:\n[    5.017392] CPU: 3 UID: 0 PID: 57 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.030422] Tainted: [W]=WARN\n[    5.033391] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    5.042085] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.048529] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.052979] Code: 48 8b 15 c4 43 f0 60 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.071724] RSP: 0018:ffffbd4e8029bc58 EFLAGS: 00010246\n[    5.076951] RAX: 0000000000000000 RBX: ffffa078c6dbbd08 RCX: 0000000000000000\n[    5.084082] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd4e8029bcb8\n[    5.091215] RBP: ffffa078c6dbbd08 R08: ffffbd4e8029bde8 R09: 0000000000000000\n[    5.098347] R10: ffffbd4e8029bb30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.105481] R13: ffffa078c6db4fe0 R14: ffffbd4e8029bc60 R15: 0000000000000001\n[    5.112615] FS:  0000000000000000(0000) GS:ffffa078eaf80000(0000) knlGS:0000000000000000\n[    5.120702] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.126446] CR2: 0000000000000000 CR3: 000000002a428000 CR4: 00000000003506f0\n[    5.133580] Call Trace:\n[    5.136032]  <TASK>\n[    5.138136]  ? __warn+0x85/0x130\n[    5.141373]  ? __flush_work+0x29f/0x2c0\n[    5.145214]  ? report_bug+0x160/0x190\n[    5.148882]  ? handle_bug+0x53/0x90\n[    5.152379]  ? exc_invalid_op+0x13/0x60\n[    5.156220]  ? asm_exc_invalid_op+0x16/0x20\n[    5.160411]  ? __flush_work+0x29f/0x2c0\n[    5.164253]  cancel_delayed_work_sync+0x6e/0x90\n[    5.168789]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.173325]  amdgpu_ring_alloc+0x3f/0x60\n[    5.177255]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.181359]  amdgpu_job_submit_direct+0x30/0x50\n[    5.185895]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.190862]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.195222]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.201056]  process_one_work+0x18b/0x3d0\n[    5.205072]  worker_thread+0x2e4/0x420\n[    5.208827]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.213709]  ? rescuer_thread+0x5d0/0x5d0\n[    5.217722]  kthread+0xdf/0x110\n[    5.220869]  ? kthread_park+0x90/0x90\n[    5.224536]  ret_from_fork+0x30/0x50\n[    5.228116]  ? kthread_park+0x90/0x90\n[    5.231781]  ret_from_fork_asm+0x11/0x20\n[    5.235711]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5dab87a1076e20c4fd3c36d64d874918b6a30499', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406f4a11fb139cb87e1e0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5dab87a1076e20c4fd3c36d64d874918b6a30499', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406f4a11fb139cb87e1e0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df611fb139cb87dffb6
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f4a11fb139cb87e1e0b
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f4a11fb139cb87e1e0c
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f4a11fb139cb87e1e0d
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5238d616fac141aad22b206dc7ee9807255fe9f
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5238d616fac141aad22b206dc7ee9807255fe9f
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5dab87a1076e20c4fd3c36d64d874918b6a30499
11/22/2024 01:09:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5dab87a1076e20c4fd3c36d64d874918b6a30499
11/22/2024 01:09:15 PM UTC [INFO] Received an event for node: 67406d2111fb139cb87dfb05
11/22/2024 01:09:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2111fb139cb87dfb05
11/22/2024 01:09:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7411fb139cb87e1e13
11/22/2024 01:09:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7411fb139cb87e1e14
11/22/2024 01:09:17 PM UTC [INFO] Received an event for node: 67406d1111fb139cb87dfab7
11/22/2024 01:11:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:03a68da7be84fe1029729e60ca2f77d79697f4a6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1111fb139cb87dfab7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:03a68da7be84fe1029729e60ca2f77d79697f4a6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d1111fb139cb87dfab7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:30bb096b47bbb5740b0fe720b65776f51120873a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30bb096b47bbb5740b0fe720b65776f51120873a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ac47b552ce51f9d24b522309fbe04d1bdf9c95ca', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac47b552ce51f9d24b522309fbe04d1bdf9c95ca', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:42c0e4d06259bf76321cb2b97c11db4ad84540b7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:42c0e4d06259bf76321cb2b97c11db4ad84540b7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0873da51ca290bb2deb8face79efe53aac8d2b59', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0873da51ca290bb2deb8face79efe53aac8d2b59', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6a62b65c632fdc178100f28da509bdf7585dbca1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a62b65c632fdc178100f28da509bdf7585dbca1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7511fb139cb87e1e27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aa386c90878c717e6e84fc3adb45f78a0e5986dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aa386c90878c717e6e84fc3adb45f78a0e5986dc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1ec2f6650dc3709bcd05a77d608f671577628862', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1ec2f6650dc3709bcd05a77d608f671577628862', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dcb13556d0128213a783c7130e44cc0a54cfff9c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dcb13556d0128213a783c7130e44cc0a54cfff9c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fe4e143fc485b9268673b467f2f5656da706006f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fe4e143fc485b9268673b467f2f5656da706006f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a6f506fa15027971630efbf98b2d89f87dbcbfe4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a6f506fa15027971630efbf98b2d89f87dbcbfe4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:042e3d94fb90d6a118d15036cdd5c34dd1a076bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:042e3d94fb90d6a118d15036cdd5c34dd1a076bf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5628445b0414cee101f0af18c16b1977f75d7d8f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5628445b0414cee101f0af18c16b1977f75d7d8f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ff9481f9e9266f21cd1027c53009ab436a2539ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ff9481f9e9266f21cd1027c53009ab436a2539ef', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d8daaa97228a9633d79805352a9c4a1a97b6a710', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8daaa97228a9633d79805352a9c4a1a97b6a710', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7c2ad3e89dd739120d9e414127cf2d966f642e50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7c2ad3e89dd739120d9e414127cf2d966f642e50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a4e3606e52b77fd7aff968ce0c48b7efd5ff842d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4e3606e52b77fd7aff968ce0c48b7efd5ff842d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2ca5838ca3c8a46d9e5c2f875903da650ea03b0f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2ca5838ca3c8a46d9e5c2f875903da650ea03b0f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e8ca825f96cb75abe0e8b7e74a6a45662bd679a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e8ca825f96cb75abe0e8b7e74a6a45662bd679a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c4c075a42e7004589dc938e0eed68798a58832aa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c4c075a42e7004589dc938e0eed68798a58832aa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5af30d0930aa05ae68bc87494e549c757eda53ee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5af30d0930aa05ae68bc87494e549c757eda53ee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5fb46d55d4ac5a53302fc974b686f0f2492432bb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5fb46d55d4ac5a53302fc974b686f0f2492432bb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:94c8a9137b71fb3c94c8b835452bdc3280f6b969', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:94c8a9137b71fb3c94c8b835452bdc3280f6b969', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:07da5bd728138cd589cef6dadc311cdb8f6a3c23', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:07da5bd728138cd589cef6dadc311cdb8f6a3c23', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4598c55bcc557439e50737a7e578deaf03f0d95f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4598c55bcc557439e50737a7e578deaf03f0d95f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:33ce69789606883ff93e9d26d89c43f881d06f78', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:33ce69789606883ff93e9d26d89c43f881d06f78', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aadd9f13b8d20d928868fa66b0423ee4668530fa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aadd9f13b8d20d928868fa66b0423ee4668530fa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cae5df7ca1bce1b6f0566c3e5060ee9b6a03820e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cae5df7ca1bce1b6f0566c3e5060ee9b6a03820e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a602c8728a6965fd5120ae9f53ce3d3f57af9bfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a602c8728a6965fd5120ae9f53ce3d3f57af9bfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:788c04e8f4f36e8adb87ac148e3a3ad09536d68c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:788c04e8f4f36e8adb87ac148e3a3ad09536d68c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d3df9421fd800f2ef64566347a933da709b99ef6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d3df9421fd800f2ef64566347a933da709b99ef6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f37d0e9e7c6185d52eb409923e595169d51c1cfb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f37d0e9e7c6185d52eb409923e595169d51c1cfb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:29dee2dd6d7188128bcf35718f7041839b3047f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29dee2dd6d7188128bcf35718f7041839b3047f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dbb4c3f08bd53d0cede0af2b090c68a82d0e1999', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dbb4c3f08bd53d0cede0af2b090c68a82d0e1999', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc90de87376e59aa1f34a9edf78bc5fc638fa3b9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc90de87376e59aa1f34a9edf78bc5fc638fa3b9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b692585056a40677fbc1b993d1ffcec54d6c0746', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b692585056a40677fbc1b993d1ffcec54d6c0746', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:20114dee2c3cc6ae040114feb14203318f6e710d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:20114dee2c3cc6ae040114feb14203318f6e710d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:556cb8f1c2e96b7c72245041e57f1767fe072e9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:556cb8f1c2e96b7c72245041e57f1767fe072e9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:70104b8261e661b104b49057754b7803b0f71073', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:70104b8261e661b104b49057754b7803b0f71073', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7d4a0f80eee25912dc8cb6e37be5b0692bbafd46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7d4a0f80eee25912dc8cb6e37be5b0692bbafd46', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1bed77a2e04e1b75c80cc8a938b3ebdc2f0a1b89', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1bed77a2e04e1b75c80cc8a938b3ebdc2f0a1b89', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:feed47ecd1bf56947911683e5adee8b07566c02e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:feed47ecd1bf56947911683e5adee8b07566c02e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1399c73053a7a3ac7f1d1b9a4478b0795c9eecac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1399c73053a7a3ac7f1d1b9a4478b0795c9eecac', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d03dbc847719ddf65276ad99fcc3f263393dcb9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d03dbc847719ddf65276ad99fcc3f263393dcb9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a5c2060a4f3f5c7f522386adc00db275e8bf3f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a5c2060a4f3f5c7f522386adc00db275e8bf3f9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a58b71cc143ba6bec5ec24ff439890f8325a62f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a58b71cc143ba6bec5ec24ff439890f8325a62f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d840c3e1dbcb85644c823944d415625803ff365f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d840c3e1dbcb85644c823944d415625803ff365f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:84bbfd066b91165747745a5bcd123b4544ba91e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:84bbfd066b91165747745a5bcd123b4544ba91e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ee4ae6ae71d0d4e870bc031995408eab08fcfefa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee4ae6ae71d0d4e870bc031995408eab08fcfefa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3e5aaa05ca0dcd91dce667c0d42774f3bf290ec5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3e5aaa05ca0dcd91dce667c0d42774f3bf290ec5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6aed9f5c68bf2675b16e42136045193167aa189e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6aed9f5c68bf2675b16e42136045193167aa189e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7e612bb730ed00b33cc7dc70bb7cf79b425db0f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e612bb730ed00b33cc7dc70bb7cf79b425db0f3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:56373ff37fcde0068c8e3a345c88e43cb878f046', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:56373ff37fcde0068c8e3a345c88e43cb878f046', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:849caa60ff05de12ba32fab6b80e235be7fe5304', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:849caa60ff05de12ba32fab6b80e235be7fe5304', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a309f761df9b9523efa18a5570d6fdff67eb8331', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a309f761df9b9523efa18a5570d6fdff67eb8331', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1464d4ec56c24e8bb98bfbed4a84ae509820cc73', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1464d4ec56c24e8bb98bfbed4a84ae509820cc73', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d4cccdaa95c209309ba74f1935ffa9c28cf9caad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d4cccdaa95c209309ba74f1935ffa9c28cf9caad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:651b677a80ba0cb2ffb44d539da367a1808c7e66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:651b677a80ba0cb2ffb44d539da367a1808c7e66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cb887ea8b117f13d02689e4d47fac64f5ef06b83', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cb887ea8b117f13d02689e4d47fac64f5ef06b83', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:18c2034904cc0b861de5494b078b2d6e4fff2089', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18c2034904cc0b861de5494b078b2d6e4fff2089', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aad2349922d2a146f5175ed0644fca76d72f1474', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aad2349922d2a146f5175ed0644fca76d72f1474', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1e5d990d49f9dd945ca9588098d0c3c54b301a49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e5d990d49f9dd945ca9588098d0c3c54b301a49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c0e018409dac2c1caf28e15a7aabac5bb19769c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c0e018409dac2c1caf28e15a7aabac5bb19769c0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e198dbb002984b227b81d8608565f9f9f6f38ca0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e198dbb002984b227b81d8608565f9f9f6f38ca0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:88700a9e8857a74ab9f2bcfab10b0f4c08c70514', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:88700a9e8857a74ab9f2bcfab10b0f4c08c70514', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0a64636d60644517aeb62bdc90aeea64086a5407', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0a64636d60644517aeb62bdc90aeea64086a5407', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f89f4b8a15ea042ab3da0d74b842a0a2ae79990f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f89f4b8a15ea042ab3da0d74b842a0a2ae79990f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:680b1aaf90a96c573fea3fcdc567d9448b169b1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:680b1aaf90a96c573fea3fcdc567d9448b169b1a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bd02d47576007f0802683244dd880d5ac331d6b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bd02d47576007f0802683244dd880d5ac331d6b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e2957a43dc8d45ca2d9d27c5b2ea9edbd0185a59', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e2957a43dc8d45ca2d9d27c5b2ea9edbd0185a59', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:478c9e94090d059028504cfe59c7299818e3059d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:478c9e94090d059028504cfe59c7299818e3059d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3a5d3f38e037ab6c2634d78b937a311c22b641e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3a5d3f38e037ab6c2634d78b937a311c22b641e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fb7b45f01837fc8553d69b36e993923ae7431103', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fb7b45f01837fc8553d69b36e993923ae7431103', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c0cae3c022e36452c93acd4ee221834b82ac4e4c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c0cae3c022e36452c93acd4ee221834b82ac4e4c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:758d8086d7c46d1b7657c7e77d0293b4c557bc31', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:758d8086d7c46d1b7657c7e77d0293b4c557bc31', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:68d65a52a244712c6ded9004ce111827e9bd7ed0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68d65a52a244712c6ded9004ce111827e9bd7ed0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c936f1efefa969559b26534550691e1e3f03808f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c936f1efefa969559b26534550691e1e3f03808f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:385868c3f207a8b964cc3cb3c349dfd0ff26a073', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:385868c3f207a8b964cc3cb3c349dfd0ff26a073', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e88346f846c8cdf47e930e00145ca56f41ef9e2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e88346f846c8cdf47e930e00145ca56f41ef9e2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2a71d4547bf075ffc5af183db1c4778a85dfa616', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a71d4547bf075ffc5af183db1c4778a85dfa616', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8f39f767875c887f934328bf570f8c3a7b5ef46e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f39f767875c887f934328bf570f8c3a7b5ef46e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c8f5fe96855754ddbf52dc13afa2bcd094b24f80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c8f5fe96855754ddbf52dc13afa2bcd094b24f80', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:62f5daa802c61d8a39d2df03aa63818138aad37a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:62f5daa802c61d8a39d2df03aa63818138aad37a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7f3bf35d5909c4f61225a45107bf2818705351e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7f3bf35d5909c4f61225a45107bf2818705351e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:36d4b60b6dd6605703d73c6afe1cfbec8721cf79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:36d4b60b6dd6605703d73c6afe1cfbec8721cf79', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:eba7a5c46d1a6e801bac9c0083f3db44699849b9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eba7a5c46d1a6e801bac9c0083f3db44699849b9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:97682485b07249d8914423f02b8d2444ca7c3a22', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:97682485b07249d8914423f02b8d2444ca7c3a22', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7bbf065e8787c428848ddb99c5c1d8714911ef2c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7bbf065e8787c428848ddb99c5c1d8714911ef2c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4b36346b2a068449878d76c386320f9b1ed43dee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4b36346b2a068449878d76c386320f9b1ed43dee', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4c2856fd0b2723042cc82eba8356f9dc3b44f1db', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c2856fd0b2723042cc82eba8356f9dc3b44f1db', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2557c869c10444e49cf5d4328da65ccbfcbdacd8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2557c869c10444e49cf5d4328da65ccbfcbdacd8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:77c3e7c4ce4243e4925db09a827140a8415b9f95', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:77c3e7c4ce4243e4925db09a827140a8415b9f95', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8414a7078e8f0582b25978e15eb251df8bd14b0a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8414a7078e8f0582b25978e15eb251df8bd14b0a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1f39232811f8bb4c23d6c7dbf9d5d51558dec4d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1f39232811f8bb4c23d6c7dbf9d5d51558dec4d3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0c23d1a298e6fa6dfeb10a64ad770584760be1f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c23d1a298e6fa6dfeb10a64ad770584760be1f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d967ab6522a06ed8069606d4d165e352a4f10601', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d967ab6522a06ed8069606d4d165e352a4f10601', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ebb798e6f6092585646b2bb7477db7c9c53a573a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ebb798e6f6092585646b2bb7477db7c9c53a573a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d751eabb0ffcbca6b6943c5ca8dbb89b02094c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d751eabb0ffcbca6b6943c5ca8dbb89b02094c6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6faf2bfba9483a7e49242441c1c590f374daf85c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6faf2bfba9483a7e49242441c1c590f374daf85c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:337bfcd4cba7ca10ed65cf93994ccbf2d5ac5f24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:337bfcd4cba7ca10ed65cf93994ccbf2d5ac5f24', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1eb5e74a6da6a38f56622764fae8b6a8c677f49c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1eb5e74a6da6a38f56622764fae8b6a8c677f49c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d17cd47434e9351f8489a4593f2ac27df7d3b873', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d17cd47434e9351f8489a4593f2ac27df7d3b873', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2b455abdcf0907ff5a05c0ea30c6388461e2a42e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2b455abdcf0907ff5a05c0ea30c6388461e2a42e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9bc1f7bce7bca8118245ccf31f97df56f4376913', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9bc1f7bce7bca8118245ccf31f97df56f4376913', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2181e88aded1fb7672a365964dbd23b63fa5b206', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2181e88aded1fb7672a365964dbd23b63fa5b206', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:71214355b4f02c800ae6aa1b239d734fea82bc9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:71214355b4f02c800ae6aa1b239d734fea82bc9b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ebd42163df278def0344b773b341ee9c2fac5711', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ebd42163df278def0344b773b341ee9c2fac5711', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d04c7cb98822793ba7ccbbe3c2a939900eb40d07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d04c7cb98822793ba7ccbbe3c2a939900eb40d07', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a2c1885c3a880af982ea9992001abe903689999c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a2c1885c3a880af982ea9992001abe903689999c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f2ea992efbae32cfa3c5008b03bf6c2c9dd30324', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f2ea992efbae32cfa3c5008b03bf6c2c9dd30324', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d9b36c0bedb8ba619349b37bc7f168a38256052a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9b36c0bedb8ba619349b37bc7f168a38256052a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2777d84c5f549666de740e06b4da69afe2cd1d42', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2777d84c5f549666de740e06b4da69afe2cd1d42', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:91d843d4523dad2d7ddcda4d4fa13706c863a78e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:91d843d4523dad2d7ddcda4d4fa13706c863a78e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1bec50240406b76103993c3f430570a81fad2e50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1bec50240406b76103993c3f430570a81fad2e50', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:424b6f1ba1ca5a1e7e9c7a8bf556346d55ff6b99', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:424b6f1ba1ca5a1e7e9c7a8bf556346d55ff6b99', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7f784e69e53c60ff5598846653db340be67fce6a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7f784e69e53c60ff5598846653db340be67fce6a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e45570e1b2d56b6c79f4f37ac9aa8e6c2ec1af39', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e45570e1b2d56b6c79f4f37ac9aa8e6c2ec1af39', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b706ae0738342d518a45862d1e69d0ab9e0a135', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b706ae0738342d518a45862d1e69d0ab9e0a135', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4d12ef232dfaa9e79a4445425fb8cf18adf9d097', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d12ef232dfaa9e79a4445425fb8cf18adf9d097', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ffaa1e192258df59a2bd356d4fc9f67093259365', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ffaa1e192258df59a2bd356d4fc9f67093259365', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f035dea837630fc3f910d8e0e21474425d0d1a73', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f035dea837630fc3f910d8e0e21474425d0d1a73', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9d1da25aa5fdee3e55b7cb46a7e37284f3f27426', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9d1da25aa5fdee3e55b7cb46a7e37284f3f27426', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8f18f7cef090cc9e240830577aff81067660cefe', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f18f7cef090cc9e240830577aff81067660cefe', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:68f5bb61717c604a135612285a19ee48e2a350cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68f5bb61717c604a135612285a19ee48e2a350cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d279e4734456b2d4e134f309c552f787a2d1f939', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d279e4734456b2d4e134f309c552f787a2d1f939', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7f691d4c15a65dd950a78b42fa6215f2a2f78590', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7f691d4c15a65dd950a78b42fa6215f2a2f78590', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1e9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:200d397902979b4e6cd41207d612899664b14d37', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:200d397902979b4e6cd41207d612899664b14d37', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f95afd5e9a088c0e06c32a219254f568285ee58b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f95afd5e9a088c0e06c32a219254f568285ee58b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d143ead090a8a2093465775b0f6af83bbae1e093', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d143ead090a8a2093465775b0f6af83bbae1e093', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:886eae4200f9834790973c4a2eb8c7aef6881a93', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:886eae4200f9834790973c4a2eb8c7aef6881a93', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e9ef6211c3b866aa17b220e95c331e8ad019925a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e9ef6211c3b866aa17b220e95c331e8ad019925a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aef783534cdc12daa249819ca66c76a8d597dace', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aef783534cdc12daa249819ca66c76a8d597dace', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ae16a61409a05769cd8d6f974c50e945d08af179', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ae16a61409a05769cd8d6f974c50e945d08af179', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2a384459c8d043be08f66ea5c329e228c8dedc7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a384459c8d043be08f66ea5c329e228c8dedc7d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c325170ca0099b4d9ef5c1f2df7f11abd5120fd1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c325170ca0099b4d9ef5c1f2df7f11abd5120fd1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:26f31b4067f108452c0ac3f60d0446cbf8cf89cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:26f31b4067f108452c0ac3f60d0446cbf8cf89cf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ea9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b1dcea8d37e10966c7cac48d5fc3cbfb5b4bf1b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eaa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1dcea8d37e10966c7cac48d5fc3cbfb5b4bf1b6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eaa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:66c261f3c78534253e299d0c9c537d3b1645bcfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66c261f3c78534253e299d0c9c537d3b1645bcfc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:57675e84348304068be84c7ef294d13fbcb208f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57675e84348304068be84c7ef294d13fbcb208f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:999b0f86dc2815ad9d5750da40df0b4d09876d5a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ead', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:999b0f86dc2815ad9d5750da40df0b4d09876d5a', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ead', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc1abb5811df304de3f594da7625b8a082b120fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc1abb5811df304de3f594da7625b8a082b120fc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c817792bb4c421672195177970a577ea3cbf6bb0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c817792bb4c421672195177970a577ea3cbf6bb0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dabc4d913aef35e4da7f6c72c43dc129b3993410', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dabc4d913aef35e4da7f6c72c43dc129b3993410', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b7d1b6c502bf913212dc229197c554f3d7b358da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7d1b6c502bf913212dc229197c554f3d7b358da', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3ee40540539ec44ca95169528cc30a637ded4d7e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ee40540539ec44ca95169528cc30a637ded4d7e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1d9dc985d5a5d8171202e90b15b11e94e1e45de5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1d9dc985d5a5d8171202e90b15b11e94e1e45de5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:05e085f27ba1aaa11909b14acea75ac33b56388c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:05e085f27ba1aaa11909b14acea75ac33b56388c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:29cbbcedeaf66b4953ffda3fbddcd50c1d088da7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29cbbcedeaf66b4953ffda3fbddcd50c1d088da7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:acff12d390bf8ffb2014307eff0a64e8dec1a5f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:acff12d390bf8ffb2014307eff0a64e8dec1a5f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fecd386cb60d636fb710ce7be941e701a3efa0f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fecd386cb60d636fb710ce7be941e701a3efa0f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:438680abd32f88b2471fb4c16290ffb1f9bb12e1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:438680abd32f88b2471fb4c16290ffb1f9bb12e1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df4c777477849b119a8ef324859741d6c2c79fdf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df4c777477849b119a8ef324859741d6c2c79fdf', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:84ea8bec0d9c1e264825b8685f9ab413f553ab34', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:84ea8bec0d9c1e264825b8685f9ab413f553ab34', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fd866ffbef19a16d238d7bbb918cdc6eb9af1474', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd866ffbef19a16d238d7bbb918cdc6eb9af1474', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7b5749226549c3367299184cfce5b4d60f0ecb66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7b5749226549c3367299184cfce5b4d60f0ecb66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b2c9390ff4f6fc84872a500ab538823b3fba851', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b2c9390ff4f6fc84872a500ab538823b3fba851', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1fb5c243c479a8c217172b0e1b0bd91ca11f3f15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1fb5c243c479a8c217172b0e1b0bd91ca11f3f15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:257a3480978803dda4bc3e58118ac2a7494a0ecd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:257a3480978803dda4bc3e58118ac2a7494a0ecd', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ebf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c0f5da70dfa8fd70c2fd1f0a99f77416b4d41ff3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c0f5da70dfa8fd70c2fd1f0a99f77416b4d41ff3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e86ab4ca7fbe3b2ec76af9a137a660dfa85deb9f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e86ab4ca7fbe3b2ec76af9a137a660dfa85deb9f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:da4aaae9ac00a8a81a45fc0a8650b1dc7dd2f90e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:da4aaae9ac00a8a81a45fc0a8650b1dc7dd2f90e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:144bc9c720a6357646a79063a26176c036eaa7a5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:144bc9c720a6357646a79063a26176c036eaa7a5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e896c4c4b5ba663234710ef4c98ef97345f1c7f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e896c4c4b5ba663234710ef4c98ef97345f1c7f2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:54a9f57c44c19901323d1ae74770c0431d5aeaf4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:54a9f57c44c19901323d1ae74770c0431d5aeaf4', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3fcd9dbf8526ae59fbe78ac9a7adeffdad50f323', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3fcd9dbf8526ae59fbe78ac9a7adeffdad50f323', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e0b034abb8b7a53e85dca537a8e495049d0e763b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e0b034abb8b7a53e85dca537a8e495049d0e763b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fe848c152f49b37386682b35c07796bc5bb6597e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fe848c152f49b37386682b35c07796bc5bb6597e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4722bfbf52a253aff3fb5047d93ed35a4eebff66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4722bfbf52a253aff3fb5047d93ed35a4eebff66', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ec9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:24f2fa04256998c7b144cb993132d7b4d8e2eb8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:24f2fa04256998c7b144cb993132d7b4d8e2eb8d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a0caf7d5eb5819d905364636e16b19076e154393', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a0caf7d5eb5819d905364636e16b19076e154393', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8ebc50cdab0a188103d2058f417748f4efd11d1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8ebc50cdab0a188103d2058f417748f4efd11d1d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b7efd6c627fce06f560fa2422630545d3db99ade', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7efd6c627fce06f560fa2422630545d3db99ade', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ea3f028c8d07e99131375665390d623cc69353e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ece', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ea3f028c8d07e99131375665390d623cc69353e9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ece', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fc0965b6a46934518795ddb230c4285688d6764f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc0965b6a46934518795ddb230c4285688d6764f', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ecf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2aeadd74a10a9740b33f35d481827b8fe4301324', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2aeadd74a10a9740b33f35d481827b8fe4301324', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6b23c404bd14d6f39f8a819ef06d3691dab74ee8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6b23c404bd14d6f39f8a819ef06d3691dab74ee8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:11:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:937e2cea5b145b50c870c422627865f2a06af7e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:937e2cea5b145b50c870c422627865f2a06af7e7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:35e824b077ea041f1e8e0f87776c07ecde482b15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:35e824b077ea041f1e8e0f87776c07ecde482b15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:86a0de917b8307da5983446009b0f070bdacf42c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:86a0de917b8307da5983446009b0f070bdacf42c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a7a7e2be0f4d465eb13eb4a46ad14c2e70032d2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a7a7e2be0f4d465eb13eb4a46ad14c2e70032d2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:03e6c467594a3e226277160bdf90e2944add7aa8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:03e6c467594a3e226277160bdf90e2944add7aa8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c6f044bddd0ed92d86ce58d81005cb7ea21a79f8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c6f044bddd0ed92d86ce58d81005cb7ea21a79f8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0c6b7e53c003be56aff2d92ba109623ade75d4bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c6b7e53c003be56aff2d92ba109623ade75d4bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:24c31185e4b357ac3c745019b158a6a4ec0f7f8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:24c31185e4b357ac3c745019b158a6a4ec0f7f8e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ed9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1f14bd7c1bdc7e19dcae393f3837bd750b463caa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eda', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1f14bd7c1bdc7e19dcae393f3837bd750b463caa', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eda', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9d0918e168b8dbed95a8e5ba00fc63a3c915283b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9d0918e168b8dbed95a8e5ba00fc63a3c915283b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5df13cd148bccc60bbfd7e457c0eb223dadccffb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5df13cd148bccc60bbfd7e457c0eb223dadccffb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d41c7baf47093c379e2e2ea16f399a815712c7c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d41c7baf47093c379e2e2ea16f399a815712c7c', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c088fa9d07bfd80aedad7314e023ad39ba54fd2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ede', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c088fa9d07bfd80aedad7314e023ad39ba54fd2e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ede', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c905ae974269e5a75f326ccbc22b4eb8e079795e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c905ae974269e5a75f326ccbc22b4eb8e079795e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1edf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3e70d1a265cf878ac8f0a7dc067b4bf0f2205916', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3e70d1a265cf878ac8f0a7dc067b4bf0f2205916', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9d920f5707ed6b8ca9c3a2718a1e63d61e497f7b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9d920f5707ed6b8ca9c3a2718a1e63d61e497f7b', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a226f8f96230b72d6cdc0013f5dc7b00b33e7f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a226f8f96230b72d6cdc0013f5dc7b00b33e7f5', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c129b56e6b97de806f2a09544bc67c238cf388c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c129b56e6b97de806f2a09544bc67c238cf388c9', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:63e51e996db6f23264624e28771c57e8a7fe4ee7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63e51e996db6f23264624e28771c57e8a7fe4ee7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc7f4d6f6bc7d2f0df587c22025b7f222cf66ce6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc7f4d6f6bc7d2f0df587c22025b7f222cf66ce6', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:70cd394a9881637e3d2710af3ad674438a3b3f90', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:70cd394a9881637e3d2710af3ad674438a3b3f90', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:162cf51b5f5f6e1a597ba4e33b1e812ecc368f41', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:162cf51b5f5f6e1a597ba4e33b1e812ecc368f41', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7b9b781116ddebf44c11b14c9c7a95184b0010bb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7b9b781116ddebf44c11b14c9c7a95184b0010bb', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d1abe93a1fc9ad87301f101bfc0ca13efa0b0985', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d1abe93a1fc9ad87301f101bfc0ca13efa0b0985', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ee9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ed19169fbe21693881780ddef0cb18337e21036', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ed19169fbe21693881780ddef0cb18337e21036', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:81739d1d14f07e1eec60f97c183f7aa6f2b8e4b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eeb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:81739d1d14f07e1eec60f97c183f7aa6f2b8e4b2', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eeb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6ee8ce7ae6df5803570e0031b398ddd7a39b0b94', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ee8ce7ae6df5803570e0031b398ddd7a39b0b94', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9a876fa3cee832af2caacede4fbd6957cec13d04', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a876fa3cee832af2caacede4fbd6957cec13d04', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fc6e620741b08a14e4ab8d546d40debf35f739cc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc6e620741b08a14e4ab8d546d40debf35f739cc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:eb54010259f2fa5637ae46a6af3853617ece6ba1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eb54010259f2fa5637ae46a6af3853617ece6ba1', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1eef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4a5f176a5784837c278a6234e5a20bf17cd0fc45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a5f176a5784837c278a6234e5a20bf17cd0fc45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:05212df979469701c0a742fdf577aba5e5b3cf98', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:05212df979469701c0a742fdf577aba5e5b3cf98', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e3fb0803c0a11044e4ff2b8a40376081b96e7f53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e3fb0803c0a11044e4ff2b8a40376081b96e7f53', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efab91d554e4b123fd4e7abc1fddc2d4b2e75bde', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:efab91d554e4b123fd4e7abc1fddc2d4b2e75bde', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cda486c97f43bd52e790b68d4fbd4f9901c1daa3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cda486c97f43bd52e790b68d4fbd4f9901c1daa3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dc436ba17a227e34015107bec0bc32bd04cbabba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc436ba17a227e34015107bec0bc32bd04cbabba', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:da26482883c7e5bf7bf0465ea0dd62a8437ba9e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:da26482883c7e5bf7bf0465ea0dd62a8437ba9e8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ba05e6e8e15aa017b4eb13ad952e5577258ee2f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ba05e6e8e15aa017b4eb13ad952e5577258ee2f7', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:27677b93553c2c8508a9e333faca09ccec61efe8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:27677b93553c2c8508a9e333faca09ccec61efe8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2912c4ab46e75cbea4d58e28962007534e97c422', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2912c4ab46e75cbea4d58e28962007534e97c422', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1ef9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6afd453723afc6426235833fb8098385cbd4f454', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6afd453723afc6426235833fb8098385cbd4f454', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:60b347de9cc366af0f6f60ca6245382ab5b5d7bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:60b347de9cc366af0f6f60ca6245382ab5b5d7bc', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.267631] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.275549] Modules linked in:\n[    4.278611] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.286352] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.295736] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.300182] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.318927] RSP: 0018:ffffbd0440037b30 EFLAGS: 00010246\n[    4.324152] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    4.331283] RDX: ffffbd0440037b38 RSI: 0000000000000001 RDI: ffffbd0440037b80\n[    4.338414] RBP: ffff9c3e040388e8 R08: ffff9c3e0402f6f0 R09: ffff9c3e01ba7000\n[    4.345543] R10: 0000000000000040 R11: ffffffffaea58840 R12: ffff9c3e04000000\n[    4.352675] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.359805] FS:  0000000000000000(0000) GS:ffff9c3f26e00000(0000) knlGS:0000000000000000\n[    4.367890] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.373635] CR2: 00007f766910c160 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    4.380766] Call Trace:\n[    4.383219]  <TASK>\n[    4.385326]  ? __warn+0x84/0x130\n[    4.388561]  ? __flush_work+0x2d6/0x300\n[    4.392399]  ? report_bug+0x164/0x190\n[    4.396069]  ? handle_bug+0x54/0x90\n[    4.399563]  ? exc_invalid_op+0x17/0x70\n[    4.403401]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.407591]  ? __flush_work+0x2d6/0x300\n[    4.411436]  cancel_delayed_work_sync+0x5c/0x80\n[    4.415969]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.420510]  amdgpu_ring_alloc+0x3e/0x60\n[    4.424439]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.429577]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.434023]  amdgpu_device_init+0x1e4f/0x2530\n[    4.438384]  amdgpu_driver_load_kms+0x14/0x80\n[    4.442745]  amdgpu_pci_probe+0x150/0x490\n[    4.446760]  local_pci_probe+0x3d/0x90\n[    4.450514]  pci_device_probe+0xb5/0x180\n[    4.454441]  really_probe+0xcc/0x2b0\n[    4.458022]  ? __pfx___driver_attach+0x10/0x10\n[    4.462470]  __driver_probe_device+0x6e/0x110\n[    4.466830]  driver_probe_device+0x1a/0xe0\n[    4.470931]  __driver_attach+0x83/0x180\n[    4.474770]  bus_for_each_dev+0x83/0xd0\n[    4.478611]  bus_add_driver+0xe3/0x210\n[    4.482363]  driver_register+0x54/0x100\n[    4.486203]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.490306]  do_one_initcall+0x56/0x220\n[    4.494150]  kernel_init_freeable+0x19e/0x2d0\n[    4.498511]  ? __pfx_kernel_init+0x10/0x10\n[    4.502610]  kernel_init+0x15/0x1c0\n[    4.506101]  ret_from_fork+0x2f/0x50\n[    4.509680]  ? __pfx_kernel_init+0x10/0x10\n[    4.513778]  ret_from_fork_asm+0x1a/0x30\n[    4.517706]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.676553] WARNING: CPU: 3 PID: 174 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.684651] Modules linked in: snd_acp3x_pcm_dma snd_acp3x_i2s btusb snd_sof_amd_rembrandt btrtl uvcvideo snd_sof_amd_renoir btintel snd_sof_amd_acp snd_acp_config videobuf2_vmalloc videobuf2_memops snd_sof_pci btbcm snd_sof_xtensa_dsp uvc videobuf2_v4l2 btmtk snd_soc_acp_rt5682_mach bluetooth videobuf2_common cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_usbpd_charger cros_usbpd_logger snd_soc_rt5682_i2c snd_sof memconsole_coreboot snd_sof_utils snd_soc_rt5682 snd_soc_rl6231 vpd_sysfs regmap_i2c memconsole sp5100_tco snd_soc_acpi cros_ec_typec snd_soc_acp_da7219mx98357_mach acpi_als watchdog snd_soc_cros_ec_codec industrialio_triggered_buffer acp_audio_dma iwlmvm gsmi snd_soc_max98357a cros_ec_dev roles kfifo_buf iwlwifi i2c_piix4 snd_pci_acp3x snd_soc_core i2c_hid_acpi i2c_hid i2c_cros_ec_tunnel cros_usbpd_notify typec industrialio snd_compress raydium_i2c_ts snd_pcm_dmaengine elan_i2c chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.764440] iwlwifi 0000:01:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0\n[    6.771276] CPU: 3 UID: 0 PID: 174 Comm: kworker/3:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.788405] Tainted: [W]=WARN\n[    6.791378] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.800765] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.807208] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.811655] Code: 70 9e b7 54 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.830407] RSP: 0018:ffffbd04410e3c70 EFLAGS: 00010246\n[    6.835634] RAX: 0000000000000000 RBX: ffff9c3e040388e8 RCX: 0000000000000000\n[    6.842766] RDX: ffffbd04410e3c78 RSI: 0000000000000001 RDI: ffffbd04410e3cc0\n[    6.849903] RBP: ffff9c3e040388e8 R08: ffffbd04410e3df0 R09: 0000000000000000\n[    6.857037] R10: ffffbd04410e3b38 R11: fffffffffffd9943 R12: 00000000000003e8\n[    6.864168] R13: 0000000000000001 R14: ffff9c3e04000000 R15: ffff9c3e040323c0\n[    6.871299] FS:  0000000000000000(0000) GS:ffff9c3f26f80000(0000) knlGS:0000000000000000\n[    6.879388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.885132] CR2: 00007fba3c19b6c0 CR3: 000000006de2e000 CR4: 00000000003506f0\n[    6.892263] Call Trace:\n[    6.894714]  <TASK>\n[    6.896818]  ? __warn+0x84/0x130\n[    6.900053]  ? __flush_work+0x2d6/0x300\n[    6.903889]  ? report_bug+0x164/0x190\n[    6.907556]  ? handle_bug+0x54/0x90\n[    6.911051]  ? exc_invalid_op+0x17/0x70\n[    6.914893]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.919083]  ? __flush_work+0x2d6/0x300\n[    6.922925]  cancel_delayed_work_sync+0x5c/0x80\n[    6.927461]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.931999]  amdgpu_ring_alloc+0x3e/0x60\n[    6.935927]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.940029]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.944571]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.949538]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.953902]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.959739]  process_one_work+0x163/0x390\n[    6.963757]  worker_thread+0x2a0/0x3b0\n[    6.967514]  ? __pfx_worker_thread+0x10/0x10\n[    6.971790]  ? __pfx_worker_thread+0x10/0x10\n[    6.976069]  kthread+0xcb/0xf0\n[    6.979139]  ? __pfx_kthread+0x10/0x10\n[    6.982888]  ret_from_fork+0x2f/0x50\n[    6.986471]  ? __pfx_kthread+0x10/0x10\n[    6.990225]  ret_from_fork_asm+0x1a/0x30\n[    6.994160]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5dc2c1a5fa6ec943f18941f87f5a3dac42f3a108', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5dc2c1a5fa6ec943f18941f87f5a3dac42f3a108', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406f7611fb139cb87e1efc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1111fb139cb87dfab7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e1f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e20
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e21
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e22
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e23
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e24
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e25
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e26
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7511fb139cb87e1e27
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e28
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e29
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e2f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e30
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e31
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e32
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e33
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e34
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e35
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e36
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e37
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e38
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e39
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e3f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e40
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e41
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e42
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e43
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e44
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e45
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e46
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e47
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e48
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e49
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e4f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e50
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e51
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e52
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e53
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e54
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e55
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e56
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e57
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e58
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e59
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e5f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e60
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e61
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e62
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e63
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e64
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e65
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e67
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e68
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e69
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e6f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e70
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e71
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e72
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e73
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e74
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e75
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e76
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e77
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e78
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e79
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e7f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e80
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e81
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e82
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e83
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e84
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e85
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e86
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e87
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e88
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e89
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e8f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e90
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e91
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e92
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e93
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e94
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e95
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e96
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e97
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e98
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e99
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1e9f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ea9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eaa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eab
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eac
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ead
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eae
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eaf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eb9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eba
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ebb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ebc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ebd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ebe
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ebf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ec9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eca
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ecb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ecc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ecd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ece
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ecf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ed9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eda
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1edb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1edc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1edd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ede
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1edf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ee9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eea
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eeb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eec
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eed
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eee
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1eef
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1ef9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1efa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1efb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1efc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f7611fb139cb87e1efd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03a68da7be84fe1029729e60ca2f77d79697f4a6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03a68da7be84fe1029729e60ca2f77d79697f4a6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30bb096b47bbb5740b0fe720b65776f51120873a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30bb096b47bbb5740b0fe720b65776f51120873a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac47b552ce51f9d24b522309fbe04d1bdf9c95ca
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac47b552ce51f9d24b522309fbe04d1bdf9c95ca
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42c0e4d06259bf76321cb2b97c11db4ad84540b7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42c0e4d06259bf76321cb2b97c11db4ad84540b7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0873da51ca290bb2deb8face79efe53aac8d2b59
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0873da51ca290bb2deb8face79efe53aac8d2b59
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a62b65c632fdc178100f28da509bdf7585dbca1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a62b65c632fdc178100f28da509bdf7585dbca1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa386c90878c717e6e84fc3adb45f78a0e5986dc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa386c90878c717e6e84fc3adb45f78a0e5986dc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ec2f6650dc3709bcd05a77d608f671577628862
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ec2f6650dc3709bcd05a77d608f671577628862
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcb13556d0128213a783c7130e44cc0a54cfff9c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcb13556d0128213a783c7130e44cc0a54cfff9c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe4e143fc485b9268673b467f2f5656da706006f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe4e143fc485b9268673b467f2f5656da706006f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6f506fa15027971630efbf98b2d89f87dbcbfe4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6f506fa15027971630efbf98b2d89f87dbcbfe4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:042e3d94fb90d6a118d15036cdd5c34dd1a076bf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:042e3d94fb90d6a118d15036cdd5c34dd1a076bf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5628445b0414cee101f0af18c16b1977f75d7d8f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5628445b0414cee101f0af18c16b1977f75d7d8f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff9481f9e9266f21cd1027c53009ab436a2539ef
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff9481f9e9266f21cd1027c53009ab436a2539ef
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8daaa97228a9633d79805352a9c4a1a97b6a710
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8daaa97228a9633d79805352a9c4a1a97b6a710
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c2ad3e89dd739120d9e414127cf2d966f642e50
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c2ad3e89dd739120d9e414127cf2d966f642e50
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4e3606e52b77fd7aff968ce0c48b7efd5ff842d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4e3606e52b77fd7aff968ce0c48b7efd5ff842d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ca5838ca3c8a46d9e5c2f875903da650ea03b0f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2ca5838ca3c8a46d9e5c2f875903da650ea03b0f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e8ca825f96cb75abe0e8b7e74a6a45662bd679a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e8ca825f96cb75abe0e8b7e74a6a45662bd679a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4c075a42e7004589dc938e0eed68798a58832aa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4c075a42e7004589dc938e0eed68798a58832aa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5af30d0930aa05ae68bc87494e549c757eda53ee
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5af30d0930aa05ae68bc87494e549c757eda53ee
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fb46d55d4ac5a53302fc974b686f0f2492432bb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fb46d55d4ac5a53302fc974b686f0f2492432bb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:94c8a9137b71fb3c94c8b835452bdc3280f6b969
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:94c8a9137b71fb3c94c8b835452bdc3280f6b969
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:07da5bd728138cd589cef6dadc311cdb8f6a3c23
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:07da5bd728138cd589cef6dadc311cdb8f6a3c23
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4598c55bcc557439e50737a7e578deaf03f0d95f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4598c55bcc557439e50737a7e578deaf03f0d95f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33ce69789606883ff93e9d26d89c43f881d06f78
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33ce69789606883ff93e9d26d89c43f881d06f78
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aadd9f13b8d20d928868fa66b0423ee4668530fa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aadd9f13b8d20d928868fa66b0423ee4668530fa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cae5df7ca1bce1b6f0566c3e5060ee9b6a03820e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cae5df7ca1bce1b6f0566c3e5060ee9b6a03820e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a602c8728a6965fd5120ae9f53ce3d3f57af9bfc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a602c8728a6965fd5120ae9f53ce3d3f57af9bfc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:788c04e8f4f36e8adb87ac148e3a3ad09536d68c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:788c04e8f4f36e8adb87ac148e3a3ad09536d68c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3df9421fd800f2ef64566347a933da709b99ef6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3df9421fd800f2ef64566347a933da709b99ef6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f37d0e9e7c6185d52eb409923e595169d51c1cfb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f37d0e9e7c6185d52eb409923e595169d51c1cfb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29dee2dd6d7188128bcf35718f7041839b3047f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29dee2dd6d7188128bcf35718f7041839b3047f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbb4c3f08bd53d0cede0af2b090c68a82d0e1999
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbb4c3f08bd53d0cede0af2b090c68a82d0e1999
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc90de87376e59aa1f34a9edf78bc5fc638fa3b9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc90de87376e59aa1f34a9edf78bc5fc638fa3b9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b692585056a40677fbc1b993d1ffcec54d6c0746
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b692585056a40677fbc1b993d1ffcec54d6c0746
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:20114dee2c3cc6ae040114feb14203318f6e710d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:20114dee2c3cc6ae040114feb14203318f6e710d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:556cb8f1c2e96b7c72245041e57f1767fe072e9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:556cb8f1c2e96b7c72245041e57f1767fe072e9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70104b8261e661b104b49057754b7803b0f71073
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70104b8261e661b104b49057754b7803b0f71073
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d4a0f80eee25912dc8cb6e37be5b0692bbafd46
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d4a0f80eee25912dc8cb6e37be5b0692bbafd46
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1bed77a2e04e1b75c80cc8a938b3ebdc2f0a1b89
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1bed77a2e04e1b75c80cc8a938b3ebdc2f0a1b89
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feed47ecd1bf56947911683e5adee8b07566c02e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feed47ecd1bf56947911683e5adee8b07566c02e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1399c73053a7a3ac7f1d1b9a4478b0795c9eecac
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1399c73053a7a3ac7f1d1b9a4478b0795c9eecac
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d03dbc847719ddf65276ad99fcc3f263393dcb9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d03dbc847719ddf65276ad99fcc3f263393dcb9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a5c2060a4f3f5c7f522386adc00db275e8bf3f9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a5c2060a4f3f5c7f522386adc00db275e8bf3f9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a58b71cc143ba6bec5ec24ff439890f8325a62f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a58b71cc143ba6bec5ec24ff439890f8325a62f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d840c3e1dbcb85644c823944d415625803ff365f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d840c3e1dbcb85644c823944d415625803ff365f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84bbfd066b91165747745a5bcd123b4544ba91e9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84bbfd066b91165747745a5bcd123b4544ba91e9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee4ae6ae71d0d4e870bc031995408eab08fcfefa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee4ae6ae71d0d4e870bc031995408eab08fcfefa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e5aaa05ca0dcd91dce667c0d42774f3bf290ec5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e5aaa05ca0dcd91dce667c0d42774f3bf290ec5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6aed9f5c68bf2675b16e42136045193167aa189e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6aed9f5c68bf2675b16e42136045193167aa189e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e612bb730ed00b33cc7dc70bb7cf79b425db0f3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e612bb730ed00b33cc7dc70bb7cf79b425db0f3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56373ff37fcde0068c8e3a345c88e43cb878f046
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56373ff37fcde0068c8e3a345c88e43cb878f046
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:849caa60ff05de12ba32fab6b80e235be7fe5304
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:849caa60ff05de12ba32fab6b80e235be7fe5304
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a309f761df9b9523efa18a5570d6fdff67eb8331
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a309f761df9b9523efa18a5570d6fdff67eb8331
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1464d4ec56c24e8bb98bfbed4a84ae509820cc73
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1464d4ec56c24e8bb98bfbed4a84ae509820cc73
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d4cccdaa95c209309ba74f1935ffa9c28cf9caad
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d4cccdaa95c209309ba74f1935ffa9c28cf9caad
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:651b677a80ba0cb2ffb44d539da367a1808c7e66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:651b677a80ba0cb2ffb44d539da367a1808c7e66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb887ea8b117f13d02689e4d47fac64f5ef06b83
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb887ea8b117f13d02689e4d47fac64f5ef06b83
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18c2034904cc0b861de5494b078b2d6e4fff2089
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18c2034904cc0b861de5494b078b2d6e4fff2089
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aad2349922d2a146f5175ed0644fca76d72f1474
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aad2349922d2a146f5175ed0644fca76d72f1474
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e5d990d49f9dd945ca9588098d0c3c54b301a49
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e5d990d49f9dd945ca9588098d0c3c54b301a49
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0e018409dac2c1caf28e15a7aabac5bb19769c0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0e018409dac2c1caf28e15a7aabac5bb19769c0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e198dbb002984b227b81d8608565f9f9f6f38ca0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e198dbb002984b227b81d8608565f9f9f6f38ca0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88700a9e8857a74ab9f2bcfab10b0f4c08c70514
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88700a9e8857a74ab9f2bcfab10b0f4c08c70514
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a64636d60644517aeb62bdc90aeea64086a5407
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a64636d60644517aeb62bdc90aeea64086a5407
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f89f4b8a15ea042ab3da0d74b842a0a2ae79990f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f89f4b8a15ea042ab3da0d74b842a0a2ae79990f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:680b1aaf90a96c573fea3fcdc567d9448b169b1a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:680b1aaf90a96c573fea3fcdc567d9448b169b1a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd02d47576007f0802683244dd880d5ac331d6b3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd02d47576007f0802683244dd880d5ac331d6b3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2957a43dc8d45ca2d9d27c5b2ea9edbd0185a59
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2957a43dc8d45ca2d9d27c5b2ea9edbd0185a59
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:478c9e94090d059028504cfe59c7299818e3059d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:478c9e94090d059028504cfe59c7299818e3059d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a5d3f38e037ab6c2634d78b937a311c22b641e8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a5d3f38e037ab6c2634d78b937a311c22b641e8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb7b45f01837fc8553d69b36e993923ae7431103
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb7b45f01837fc8553d69b36e993923ae7431103
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0cae3c022e36452c93acd4ee221834b82ac4e4c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0cae3c022e36452c93acd4ee221834b82ac4e4c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:758d8086d7c46d1b7657c7e77d0293b4c557bc31
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:758d8086d7c46d1b7657c7e77d0293b4c557bc31
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68d65a52a244712c6ded9004ce111827e9bd7ed0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68d65a52a244712c6ded9004ce111827e9bd7ed0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c936f1efefa969559b26534550691e1e3f03808f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c936f1efefa969559b26534550691e1e3f03808f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:385868c3f207a8b964cc3cb3c349dfd0ff26a073
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:385868c3f207a8b964cc3cb3c349dfd0ff26a073
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88346f846c8cdf47e930e00145ca56f41ef9e2e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e88346f846c8cdf47e930e00145ca56f41ef9e2e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a71d4547bf075ffc5af183db1c4778a85dfa616
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a71d4547bf075ffc5af183db1c4778a85dfa616
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f39f767875c887f934328bf570f8c3a7b5ef46e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f39f767875c887f934328bf570f8c3a7b5ef46e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c8f5fe96855754ddbf52dc13afa2bcd094b24f80
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c8f5fe96855754ddbf52dc13afa2bcd094b24f80
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62f5daa802c61d8a39d2df03aa63818138aad37a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62f5daa802c61d8a39d2df03aa63818138aad37a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f3bf35d5909c4f61225a45107bf2818705351e7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f3bf35d5909c4f61225a45107bf2818705351e7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36d4b60b6dd6605703d73c6afe1cfbec8721cf79
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36d4b60b6dd6605703d73c6afe1cfbec8721cf79
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eba7a5c46d1a6e801bac9c0083f3db44699849b9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eba7a5c46d1a6e801bac9c0083f3db44699849b9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:97682485b07249d8914423f02b8d2444ca7c3a22
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:97682485b07249d8914423f02b8d2444ca7c3a22
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7bbf065e8787c428848ddb99c5c1d8714911ef2c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7bbf065e8787c428848ddb99c5c1d8714911ef2c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b36346b2a068449878d76c386320f9b1ed43dee
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b36346b2a068449878d76c386320f9b1ed43dee
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c2856fd0b2723042cc82eba8356f9dc3b44f1db
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c2856fd0b2723042cc82eba8356f9dc3b44f1db
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2557c869c10444e49cf5d4328da65ccbfcbdacd8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2557c869c10444e49cf5d4328da65ccbfcbdacd8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77c3e7c4ce4243e4925db09a827140a8415b9f95
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77c3e7c4ce4243e4925db09a827140a8415b9f95
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8414a7078e8f0582b25978e15eb251df8bd14b0a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8414a7078e8f0582b25978e15eb251df8bd14b0a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f39232811f8bb4c23d6c7dbf9d5d51558dec4d3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f39232811f8bb4c23d6c7dbf9d5d51558dec4d3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c23d1a298e6fa6dfeb10a64ad770584760be1f2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c23d1a298e6fa6dfeb10a64ad770584760be1f2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d967ab6522a06ed8069606d4d165e352a4f10601
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d967ab6522a06ed8069606d4d165e352a4f10601
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebb798e6f6092585646b2bb7477db7c9c53a573a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebb798e6f6092585646b2bb7477db7c9c53a573a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d751eabb0ffcbca6b6943c5ca8dbb89b02094c6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d751eabb0ffcbca6b6943c5ca8dbb89b02094c6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6faf2bfba9483a7e49242441c1c590f374daf85c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6faf2bfba9483a7e49242441c1c590f374daf85c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:337bfcd4cba7ca10ed65cf93994ccbf2d5ac5f24
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:337bfcd4cba7ca10ed65cf93994ccbf2d5ac5f24
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1eb5e74a6da6a38f56622764fae8b6a8c677f49c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1eb5e74a6da6a38f56622764fae8b6a8c677f49c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d17cd47434e9351f8489a4593f2ac27df7d3b873
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d17cd47434e9351f8489a4593f2ac27df7d3b873
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b455abdcf0907ff5a05c0ea30c6388461e2a42e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b455abdcf0907ff5a05c0ea30c6388461e2a42e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9bc1f7bce7bca8118245ccf31f97df56f4376913
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9bc1f7bce7bca8118245ccf31f97df56f4376913
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2181e88aded1fb7672a365964dbd23b63fa5b206
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2181e88aded1fb7672a365964dbd23b63fa5b206
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71214355b4f02c800ae6aa1b239d734fea82bc9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71214355b4f02c800ae6aa1b239d734fea82bc9b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebd42163df278def0344b773b341ee9c2fac5711
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebd42163df278def0344b773b341ee9c2fac5711
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d04c7cb98822793ba7ccbbe3c2a939900eb40d07
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d04c7cb98822793ba7ccbbe3c2a939900eb40d07
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a2c1885c3a880af982ea9992001abe903689999c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a2c1885c3a880af982ea9992001abe903689999c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2ea992efbae32cfa3c5008b03bf6c2c9dd30324
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2ea992efbae32cfa3c5008b03bf6c2c9dd30324
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9b36c0bedb8ba619349b37bc7f168a38256052a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9b36c0bedb8ba619349b37bc7f168a38256052a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2777d84c5f549666de740e06b4da69afe2cd1d42
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2777d84c5f549666de740e06b4da69afe2cd1d42
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91d843d4523dad2d7ddcda4d4fa13706c863a78e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91d843d4523dad2d7ddcda4d4fa13706c863a78e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1bec50240406b76103993c3f430570a81fad2e50
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1bec50240406b76103993c3f430570a81fad2e50
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:424b6f1ba1ca5a1e7e9c7a8bf556346d55ff6b99
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:424b6f1ba1ca5a1e7e9c7a8bf556346d55ff6b99
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f784e69e53c60ff5598846653db340be67fce6a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f784e69e53c60ff5598846653db340be67fce6a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e45570e1b2d56b6c79f4f37ac9aa8e6c2ec1af39
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e45570e1b2d56b6c79f4f37ac9aa8e6c2ec1af39
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b706ae0738342d518a45862d1e69d0ab9e0a135
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b706ae0738342d518a45862d1e69d0ab9e0a135
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d12ef232dfaa9e79a4445425fb8cf18adf9d097
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d12ef232dfaa9e79a4445425fb8cf18adf9d097
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ffaa1e192258df59a2bd356d4fc9f67093259365
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ffaa1e192258df59a2bd356d4fc9f67093259365
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f035dea837630fc3f910d8e0e21474425d0d1a73
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f035dea837630fc3f910d8e0e21474425d0d1a73
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d1da25aa5fdee3e55b7cb46a7e37284f3f27426
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d1da25aa5fdee3e55b7cb46a7e37284f3f27426
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f18f7cef090cc9e240830577aff81067660cefe
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f18f7cef090cc9e240830577aff81067660cefe
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68f5bb61717c604a135612285a19ee48e2a350cf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68f5bb61717c604a135612285a19ee48e2a350cf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d279e4734456b2d4e134f309c552f787a2d1f939
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d279e4734456b2d4e134f309c552f787a2d1f939
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f691d4c15a65dd950a78b42fa6215f2a2f78590
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f691d4c15a65dd950a78b42fa6215f2a2f78590
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:200d397902979b4e6cd41207d612899664b14d37
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:200d397902979b4e6cd41207d612899664b14d37
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f95afd5e9a088c0e06c32a219254f568285ee58b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f95afd5e9a088c0e06c32a219254f568285ee58b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d143ead090a8a2093465775b0f6af83bbae1e093
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d143ead090a8a2093465775b0f6af83bbae1e093
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:886eae4200f9834790973c4a2eb8c7aef6881a93
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:886eae4200f9834790973c4a2eb8c7aef6881a93
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e9ef6211c3b866aa17b220e95c331e8ad019925a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e9ef6211c3b866aa17b220e95c331e8ad019925a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aef783534cdc12daa249819ca66c76a8d597dace
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aef783534cdc12daa249819ca66c76a8d597dace
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ae16a61409a05769cd8d6f974c50e945d08af179
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ae16a61409a05769cd8d6f974c50e945d08af179
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a384459c8d043be08f66ea5c329e228c8dedc7d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a384459c8d043be08f66ea5c329e228c8dedc7d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c325170ca0099b4d9ef5c1f2df7f11abd5120fd1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c325170ca0099b4d9ef5c1f2df7f11abd5120fd1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26f31b4067f108452c0ac3f60d0446cbf8cf89cf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26f31b4067f108452c0ac3f60d0446cbf8cf89cf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1dcea8d37e10966c7cac48d5fc3cbfb5b4bf1b6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1dcea8d37e10966c7cac48d5fc3cbfb5b4bf1b6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66c261f3c78534253e299d0c9c537d3b1645bcfc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66c261f3c78534253e299d0c9c537d3b1645bcfc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57675e84348304068be84c7ef294d13fbcb208f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57675e84348304068be84c7ef294d13fbcb208f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:999b0f86dc2815ad9d5750da40df0b4d09876d5a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:999b0f86dc2815ad9d5750da40df0b4d09876d5a
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc1abb5811df304de3f594da7625b8a082b120fc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc1abb5811df304de3f594da7625b8a082b120fc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c817792bb4c421672195177970a577ea3cbf6bb0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c817792bb4c421672195177970a577ea3cbf6bb0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dabc4d913aef35e4da7f6c72c43dc129b3993410
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dabc4d913aef35e4da7f6c72c43dc129b3993410
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7d1b6c502bf913212dc229197c554f3d7b358da
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7d1b6c502bf913212dc229197c554f3d7b358da
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ee40540539ec44ca95169528cc30a637ded4d7e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ee40540539ec44ca95169528cc30a637ded4d7e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d9dc985d5a5d8171202e90b15b11e94e1e45de5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d9dc985d5a5d8171202e90b15b11e94e1e45de5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05e085f27ba1aaa11909b14acea75ac33b56388c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05e085f27ba1aaa11909b14acea75ac33b56388c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cbbcedeaf66b4953ffda3fbddcd50c1d088da7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cbbcedeaf66b4953ffda3fbddcd50c1d088da7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:acff12d390bf8ffb2014307eff0a64e8dec1a5f0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:acff12d390bf8ffb2014307eff0a64e8dec1a5f0
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fecd386cb60d636fb710ce7be941e701a3efa0f7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fecd386cb60d636fb710ce7be941e701a3efa0f7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:438680abd32f88b2471fb4c16290ffb1f9bb12e1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:438680abd32f88b2471fb4c16290ffb1f9bb12e1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df4c777477849b119a8ef324859741d6c2c79fdf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df4c777477849b119a8ef324859741d6c2c79fdf
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84ea8bec0d9c1e264825b8685f9ab413f553ab34
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84ea8bec0d9c1e264825b8685f9ab413f553ab34
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd866ffbef19a16d238d7bbb918cdc6eb9af1474
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd866ffbef19a16d238d7bbb918cdc6eb9af1474
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b5749226549c3367299184cfce5b4d60f0ecb66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b5749226549c3367299184cfce5b4d60f0ecb66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b2c9390ff4f6fc84872a500ab538823b3fba851
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b2c9390ff4f6fc84872a500ab538823b3fba851
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1fb5c243c479a8c217172b0e1b0bd91ca11f3f15
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1fb5c243c479a8c217172b0e1b0bd91ca11f3f15
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:257a3480978803dda4bc3e58118ac2a7494a0ecd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:257a3480978803dda4bc3e58118ac2a7494a0ecd
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0f5da70dfa8fd70c2fd1f0a99f77416b4d41ff3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0f5da70dfa8fd70c2fd1f0a99f77416b4d41ff3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e86ab4ca7fbe3b2ec76af9a137a660dfa85deb9f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e86ab4ca7fbe3b2ec76af9a137a660dfa85deb9f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da4aaae9ac00a8a81a45fc0a8650b1dc7dd2f90e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da4aaae9ac00a8a81a45fc0a8650b1dc7dd2f90e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:144bc9c720a6357646a79063a26176c036eaa7a5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:144bc9c720a6357646a79063a26176c036eaa7a5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e896c4c4b5ba663234710ef4c98ef97345f1c7f2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e896c4c4b5ba663234710ef4c98ef97345f1c7f2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54a9f57c44c19901323d1ae74770c0431d5aeaf4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54a9f57c44c19901323d1ae74770c0431d5aeaf4
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fcd9dbf8526ae59fbe78ac9a7adeffdad50f323
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fcd9dbf8526ae59fbe78ac9a7adeffdad50f323
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e0b034abb8b7a53e85dca537a8e495049d0e763b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e0b034abb8b7a53e85dca537a8e495049d0e763b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe848c152f49b37386682b35c07796bc5bb6597e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe848c152f49b37386682b35c07796bc5bb6597e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4722bfbf52a253aff3fb5047d93ed35a4eebff66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4722bfbf52a253aff3fb5047d93ed35a4eebff66
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24f2fa04256998c7b144cb993132d7b4d8e2eb8d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24f2fa04256998c7b144cb993132d7b4d8e2eb8d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0caf7d5eb5819d905364636e16b19076e154393
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0caf7d5eb5819d905364636e16b19076e154393
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ebc50cdab0a188103d2058f417748f4efd11d1d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ebc50cdab0a188103d2058f417748f4efd11d1d
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7efd6c627fce06f560fa2422630545d3db99ade
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7efd6c627fce06f560fa2422630545d3db99ade
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea3f028c8d07e99131375665390d623cc69353e9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea3f028c8d07e99131375665390d623cc69353e9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc0965b6a46934518795ddb230c4285688d6764f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc0965b6a46934518795ddb230c4285688d6764f
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2aeadd74a10a9740b33f35d481827b8fe4301324
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2aeadd74a10a9740b33f35d481827b8fe4301324
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b23c404bd14d6f39f8a819ef06d3691dab74ee8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b23c404bd14d6f39f8a819ef06d3691dab74ee8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:937e2cea5b145b50c870c422627865f2a06af7e7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:937e2cea5b145b50c870c422627865f2a06af7e7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35e824b077ea041f1e8e0f87776c07ecde482b15
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35e824b077ea041f1e8e0f87776c07ecde482b15
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86a0de917b8307da5983446009b0f070bdacf42c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86a0de917b8307da5983446009b0f070bdacf42c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a7a7e2be0f4d465eb13eb4a46ad14c2e70032d2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a7a7e2be0f4d465eb13eb4a46ad14c2e70032d2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03e6c467594a3e226277160bdf90e2944add7aa8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:03e6c467594a3e226277160bdf90e2944add7aa8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6f044bddd0ed92d86ce58d81005cb7ea21a79f8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6f044bddd0ed92d86ce58d81005cb7ea21a79f8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c6b7e53c003be56aff2d92ba109623ade75d4bc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c6b7e53c003be56aff2d92ba109623ade75d4bc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24c31185e4b357ac3c745019b158a6a4ec0f7f8e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24c31185e4b357ac3c745019b158a6a4ec0f7f8e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f14bd7c1bdc7e19dcae393f3837bd750b463caa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f14bd7c1bdc7e19dcae393f3837bd750b463caa
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d0918e168b8dbed95a8e5ba00fc63a3c915283b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d0918e168b8dbed95a8e5ba00fc63a3c915283b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5df13cd148bccc60bbfd7e457c0eb223dadccffb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5df13cd148bccc60bbfd7e457c0eb223dadccffb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d41c7baf47093c379e2e2ea16f399a815712c7c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d41c7baf47093c379e2e2ea16f399a815712c7c
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c088fa9d07bfd80aedad7314e023ad39ba54fd2e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c088fa9d07bfd80aedad7314e023ad39ba54fd2e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c905ae974269e5a75f326ccbc22b4eb8e079795e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c905ae974269e5a75f326ccbc22b4eb8e079795e
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e70d1a265cf878ac8f0a7dc067b4bf0f2205916
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e70d1a265cf878ac8f0a7dc067b4bf0f2205916
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d920f5707ed6b8ca9c3a2718a1e63d61e497f7b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d920f5707ed6b8ca9c3a2718a1e63d61e497f7b
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a226f8f96230b72d6cdc0013f5dc7b00b33e7f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a226f8f96230b72d6cdc0013f5dc7b00b33e7f5
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c129b56e6b97de806f2a09544bc67c238cf388c9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c129b56e6b97de806f2a09544bc67c238cf388c9
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63e51e996db6f23264624e28771c57e8a7fe4ee7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63e51e996db6f23264624e28771c57e8a7fe4ee7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc7f4d6f6bc7d2f0df587c22025b7f222cf66ce6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc7f4d6f6bc7d2f0df587c22025b7f222cf66ce6
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70cd394a9881637e3d2710af3ad674438a3b3f90
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70cd394a9881637e3d2710af3ad674438a3b3f90
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:162cf51b5f5f6e1a597ba4e33b1e812ecc368f41
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:162cf51b5f5f6e1a597ba4e33b1e812ecc368f41
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b9b781116ddebf44c11b14c9c7a95184b0010bb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b9b781116ddebf44c11b14c9c7a95184b0010bb
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1abe93a1fc9ad87301f101bfc0ca13efa0b0985
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1abe93a1fc9ad87301f101bfc0ca13efa0b0985
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ed19169fbe21693881780ddef0cb18337e21036
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ed19169fbe21693881780ddef0cb18337e21036
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81739d1d14f07e1eec60f97c183f7aa6f2b8e4b2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81739d1d14f07e1eec60f97c183f7aa6f2b8e4b2
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ee8ce7ae6df5803570e0031b398ddd7a39b0b94
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ee8ce7ae6df5803570e0031b398ddd7a39b0b94
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a876fa3cee832af2caacede4fbd6957cec13d04
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a876fa3cee832af2caacede4fbd6957cec13d04
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc6e620741b08a14e4ab8d546d40debf35f739cc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc6e620741b08a14e4ab8d546d40debf35f739cc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb54010259f2fa5637ae46a6af3853617ece6ba1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb54010259f2fa5637ae46a6af3853617ece6ba1
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a5f176a5784837c278a6234e5a20bf17cd0fc45
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a5f176a5784837c278a6234e5a20bf17cd0fc45
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05212df979469701c0a742fdf577aba5e5b3cf98
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05212df979469701c0a742fdf577aba5e5b3cf98
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3fb0803c0a11044e4ff2b8a40376081b96e7f53
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3fb0803c0a11044e4ff2b8a40376081b96e7f53
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efab91d554e4b123fd4e7abc1fddc2d4b2e75bde
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efab91d554e4b123fd4e7abc1fddc2d4b2e75bde
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cda486c97f43bd52e790b68d4fbd4f9901c1daa3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cda486c97f43bd52e790b68d4fbd4f9901c1daa3
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc436ba17a227e34015107bec0bc32bd04cbabba
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc436ba17a227e34015107bec0bc32bd04cbabba
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da26482883c7e5bf7bf0465ea0dd62a8437ba9e8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da26482883c7e5bf7bf0465ea0dd62a8437ba9e8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba05e6e8e15aa017b4eb13ad952e5577258ee2f7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba05e6e8e15aa017b4eb13ad952e5577258ee2f7
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27677b93553c2c8508a9e333faca09ccec61efe8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27677b93553c2c8508a9e333faca09ccec61efe8
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2912c4ab46e75cbea4d58e28962007534e97c422
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2912c4ab46e75cbea4d58e28962007534e97c422
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6afd453723afc6426235833fb8098385cbd4f454
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6afd453723afc6426235833fb8098385cbd4f454
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60b347de9cc366af0f6f60ca6245382ab5b5d7bc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60b347de9cc366af0f6f60ca6245382ab5b5d7bc
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5dc2c1a5fa6ec943f18941f87f5a3dac42f3a108
11/22/2024 01:12:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5dc2c1a5fa6ec943f18941f87f5a3dac42f3a108
11/22/2024 01:12:13 PM UTC [INFO] Received an event for node: 67406d1711fb139cb87dfade
11/22/2024 01:12:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1711fb139cb87dfade
11/22/2024 01:12:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f8d11fb139cb87e1f09
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1711fb139cb87dfade
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f03
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f04
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f05
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f06
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f07
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f08
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f09
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f0a
11/22/2024 01:12:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8d11fb139cb87e1f0b
11/22/2024 01:12:18 PM UTC [INFO] Received an event for node: 67406d1711fb139cb87dfae1
11/22/2024 01:12:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1711fb139cb87dfae1
11/22/2024 01:12:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406f8f11fb139cb87e1f17
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1711fb139cb87dfae1
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f11
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f12
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f13
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f14
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f15
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f16
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f17
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f18
11/22/2024 01:12:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406f8f11fb139cb87e1f19
11/22/2024 01:12:23 PM UTC [INFO] Received an event for node: 67406d2011fb139cb87dfb02
11/22/2024 01:12:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2011fb139cb87dfb02
11/22/2024 01:12:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fa411fb139cb87e1f1f
11/22/2024 01:12:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fa411fb139cb87e1f20
11/22/2024 01:12:26 PM UTC [INFO] Received an event for node: 67406cf011fb139cb87df9cf
11/22/2024 01:12:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf011fb139cb87df9cf
11/22/2024 01:12:27 PM UTC [INFO] Received an event for node: 67406cec11fb139cb87df9ae
11/22/2024 01:12:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cec11fb139cb87df9ae
11/22/2024 01:12:28 PM UTC [INFO] Received an event for node: 67406cee11fb139cb87df9bd
11/22/2024 01:12:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cee11fb139cb87df9bd
11/22/2024 01:12:30 PM UTC [INFO] Received an event for node: 67406cec11fb139cb87df9b1
11/22/2024 01:12:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cec11fb139cb87df9b1
11/22/2024 01:12:31 PM UTC [INFO] Received an event for node: 67406cf111fb139cb87df9d5
11/22/2024 01:12:32 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf111fb139cb87df9d5
11/22/2024 01:12:32 PM UTC [INFO] Received an event for node: 67406ced11fb139cb87df9ba
11/22/2024 01:12:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ced11fb139cb87df9ba
11/22/2024 01:12:34 PM UTC [INFO] Received an event for node: 67406cef11fb139cb87df9c3
11/22/2024 01:12:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cef11fb139cb87df9c3
11/22/2024 01:12:35 PM UTC [INFO] Received an event for node: 67406cf211fb139cb87df9d8
11/22/2024 01:12:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf211fb139cb87df9d8
11/22/2024 01:12:37 PM UTC [INFO] Received an event for node: 67406ceb11fb139cb87df9a8
11/22/2024 01:12:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ceb11fb139cb87df9a8
11/22/2024 01:12:38 PM UTC [INFO] Received an event for node: 67406cf311fb139cb87df9e1
11/22/2024 01:12:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf311fb139cb87df9e1
11/22/2024 01:12:40 PM UTC [INFO] Received an event for node: 67406d1511fb139cb87dfad5
11/22/2024 01:13:12 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1511fb139cb87dfad5
11/22/2024 01:13:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f54
11/22/2024 01:13:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f5d
11/22/2024 01:13:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f64
11/22/2024 01:13:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f65
11/22/2024 01:13:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f66
11/22/2024 01:13:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f67
11/22/2024 01:13:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f68
11/22/2024 01:13:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f69
11/22/2024 01:13:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f6a
11/22/2024 01:13:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f6b
11/22/2024 01:13:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f6c
11/22/2024 01:13:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f6d
11/22/2024 01:13:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406fe611fb139cb87e1f6e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1511fb139cb87dfad5
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f4c
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f4d
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f4e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f4f
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f50
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f51
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f52
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f53
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f54
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f55
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f56
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f57
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f58
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f59
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5a
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5b
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5c
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5d
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f5f
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f60
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f61
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f62
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f63
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f64
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f65
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f66
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f67
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f68
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f69
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6a
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6b
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6c
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6d
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f6f
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f70
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f71
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f72
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f73
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f74
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f75
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f76
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f77
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f78
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f79
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7a
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7b
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7c
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7d
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f7f
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f80
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f81
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f82
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f84
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f86
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f88
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f89
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f8b
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f8c
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f8d
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f8e
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f8f
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f90
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f91
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f92
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f93
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f94
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f95
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f96
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f97
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f98
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f99
11/22/2024 01:13:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406fe611fb139cb87e1f9a
11/22/2024 01:13:17 PM UTC [INFO] Received an event for node: 67406cf211fb139cb87df9db
11/22/2024 01:13:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf211fb139cb87df9db
11/22/2024 01:13:19 PM UTC [INFO] Received an event for node: 67406cf311fb139cb87df9e4
11/22/2024 01:13:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf311fb139cb87df9e4
11/22/2024 01:13:20 PM UTC [INFO] Received an event for node: 67406ce311fb139cb87df972
11/22/2024 01:13:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce311fb139cb87df972
11/22/2024 01:13:21 PM UTC [INFO] Received an event for node: 67406ced11fb139cb87df9b4
11/22/2024 01:13:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ced11fb139cb87df9b4
11/22/2024 01:13:23 PM UTC [INFO] Received an event for node: 67406ce711fb139cb87df98a
11/22/2024 01:13:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce711fb139cb87df98a
11/22/2024 01:13:24 PM UTC [INFO] Received an event for node: 67406d0011fb139cb87dfa3a
11/22/2024 01:13:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0011fb139cb87dfa3a
11/22/2024 01:13:25 PM UTC [INFO] Received an event for node: 67406d2a11fb139cb87dfb33
11/22/2024 01:13:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.691327] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.699074] Modules linked in:\n[    4.702137] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.709882] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.719281] EIP: __flush_work+0xb8/0xd0\n[    4.723123] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.741872] EAX: 00000000 EBX: c27aee01 ECX: 00000001 EDX: 00000000\n[    4.748138] ESI: c27aeea8 EDI: c2780000 EBP: c23f3be8 ESP: c23f3b80\n[    4.754407] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    4.761198] CR0: 80050033 CR2: ffd39000 CR3: 19d58000 CR4: 003506d0\n[    4.767464] Call Trace:\n[    4.769918]  ? show_regs+0x51/0x58\n[    4.773328]  ? __flush_work+0xb8/0xd0\n[    4.776994]  ? __warn+0x8d/0x1b8\n[    4.780239]  ? __flush_work+0xb8/0xd0\n[    4.783909]  ? __flush_work+0xb8/0xd0\n[    4.787579]  ? report_bug+0x186/0x1b0\n[    4.791250]  ? __flush_work+0xb9/0xd0\n[    4.794918]  ? exc_overflow+0x50/0x50\n[    4.798588]  ? handle_bug+0x56/0x90\n[    4.802082]  ? exc_invalid_op+0x1d/0x70\n[    4.805926]  ? handle_exception+0x14b/0x14b\n[    4.810117]  ? exc_overflow+0x50/0x50\n[    4.813784]  ? __flush_work+0xb8/0xd0\n[    4.817451]  ? exc_overflow+0x50/0x50\n[    4.821121]  ? __flush_work+0xb8/0xd0\n[    4.824793]  cancel_delayed_work_sync+0x88/0x90\n[    4.829329]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    4.833867]  ? amdgpu_device_rreg+0x40/0x64\n[    4.838056]  amdgpu_ring_alloc+0x46/0x5c\n[    4.841986]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    4.847128]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    4.852618]  amdgpu_ring_test_helper+0x20/0x90\n[    4.857068]  vcn_v1_0_hw_init+0x67/0x7c\n[    4.860909]  amdgpu_device_ip_init+0x5c5/0xa74\n[    4.865359]  amdgpu_device_init+0xc4a/0x1458\n[    4.869636]  amdgpu_driver_load_kms+0x19/0x9c\n[    4.873998]  amdgpu_pci_probe+0x153/0x570\n[    4.878011]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    4.882987]  pci_device_probe+0x8c/0x118\n[    4.886914]  ? sysfs_create_link+0x1d/0x38\n[    4.891018]  really_probe+0xc2/0x2ac\n[    4.894602]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    4.898964]  ? pm_runtime_barrier+0x52/0x90\n[    4.903152]  __driver_probe_device+0x7a/0x180\n[    4.907512]  ? lock_release+0x6c/0x140\n[    4.911269]  driver_probe_device+0x23/0x108\n[    4.915459]  __driver_attach+0x97/0x188\n[    4.919299]  ? __device_attach_driver+0x120/0x120\n[    4.924007]  bus_for_each_dev+0x71/0xc0\n[    4.927848]  driver_attach+0x19/0x20\n[    4.931429]  ? __device_attach_driver+0x120/0x120\n[    4.936139]  bus_add_driver+0xc9/0x208\n[    4.939895]  driver_register+0x52/0x10c\n[    4.943737]  __pci_register_driver+0x5f/0x68\n[    4.948009]  ? drm_sched_fence_slab_init+0x80/0x80\n[    4.952806]  amdgpu_init+0x62/0xb0\n[    4.956214]  do_one_initcall+0x63/0x2a4\n[    4.960058]  ? rdinit_setup+0x40/0x40\n[    4.963729]  ? parse_args+0x14b/0x3f4\n[    4.967400]  do_initcalls+0xdc/0x218\n[    4.970980]  ? rdinit_setup+0x40/0x40\n[    4.974648]  kernel_init_freeable+0x16b/0x2bc\n[    4.979010]  ? kernel_init+0x18/0x1f4\n[    4.982678]  ? rest_init+0x1cc/0x1cc\n[    4.986264]  kernel_init+0x18/0x1f4\n[    4.989756]  ? schedule_tail+0x50/0x60\n[    4.993514]  ret_from_fork+0x38/0x44\n[    4.997097]  ? rest_init+0x1cc/0x1cc\n[    5.000681]  ret_from_fork_asm+0x12/0x18\n[    5.004607]  entry_INT80_32+0x108/0x108\n[    5.008452] irq event stamp: 859695\n[    5.011946] hardirqs last  enabled at (859705): [<d660906e>] __up_console_sem+0x52/0x58\n[    5.019949] hardirqs last disabled at (859714): [<d6609055>] __up_console_sem+0x39/0x58\n[    5.027952] softirqs last  enabled at (859672): [<d65835b2>] handle_softirqs+0x2fe/0x41c\n[    5.036041] softirqs last disabled at (859667): [<d7e8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.256152] WARNING: CPU: 1 PID: 46 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.263998] Modules linked in:\n[    8.267068] CPU: 1 UID: 0 PID: 46 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.276552] Tainted: [W]=WARN\n[    8.279546] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    8.288940] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.295393] EIP: __flush_work+0xb8/0xd0\n[    8.299241] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.318019] EAX: 00000000 EBX: c27aee01 ECX: 00000001 EDX: 00000000\n[    8.324294] ESI: c27aeea8 EDI: c2d72b7c EBP: c150dd64 ESP: c150dcfc\n[    8.330567] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.337360] CR0: 80050033 CR2: 00000000 CR3: 19d58000 CR4: 003506d0\n[    8.343647] Call Trace:\n[    8.346111]  ? show_regs+0x51/0x58\n[    8.349530]  ? __flush_work+0xb8/0xd0\n[    8.353206]  ? __warn+0x8d/0x1b8\n[    8.356448]  ? __flush_work+0xb8/0xd0\n[    8.360122]  ? __flush_work+0xb8/0xd0\n[    8.363794]  ? report_bug+0x186/0x1b0\n[    8.367470]  ? __flush_work+0xb9/0xd0\n[    8.371143]  ? exc_overflow+0x50/0x50\n[    8.374818]  ? handle_bug+0x56/0x90\n[    8.378336]  ? exc_invalid_op+0x1d/0x70\n[    8.382207]  ? handle_exception+0x14b/0x14b\n[    8.386409]  ? exc_overflow+0x50/0x50\n[    8.390086]  ? __flush_work+0xb8/0xd0\n[    8.393761]  ? exc_overflow+0x50/0x50\n[    8.397439]  ? __flush_work+0xb8/0xd0\n[    8.401123]  cancel_delayed_work_sync+0x88/0x90\n[    8.405669]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.410234]  amdgpu_ring_alloc+0x46/0x5c\n[    8.414184]  amdgpu_ib_schedule+0x14b/0x898\n[    8.418385]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.422932]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.428520]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.433499]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.438913]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.443297]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.449159]  process_one_work+0x1b9/0x6f0\n[    8.453186]  ? process_one_work+0x16c/0x6f0\n[    8.457386]  worker_thread+0x168/0x304\n[    8.461153]  kthread+0xcc/0xf4\n[    8.464220]  ? rescuer_thread+0x33c/0x33c\n[    8.468244]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.473666]  ret_from_fork+0x38/0x44\n[    8.477274]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.482686]  ret_from_fork_asm+0x12/0x18\n[    8.486627]  entry_INT80_32+0x108/0x108\n[    8.490481] irq event stamp: 21093\n[    8.493892] hardirqs last  enabled at (21127): [<d660906e>] __up_console_sem+0x52/0x58\n[    8.501818] hardirqs last disabled at (21172): [<d6609055>] __up_console_sem+0x39/0x58\n[    8.509760] softirqs last  enabled at (21218): [<d65835b2>] handle_softirqs+0x2fe/0x41c\n[    8.517786] softirqs last disabled at (21231): [<d7e8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:aca841f41d35c6dd9a796008bffa99cc505df33d', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406d2a11fb139cb87dfb33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:81a06f6eeb32a0d6d7d0c89629154a0520061a3f', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2a11fb139cb87dfb33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:81a06f6eeb32a0d6d7d0c89629154a0520061a3f', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2a11fb139cb87dfb33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d6c044dc1426a5c22b74591134fb2a7b65ea2c68', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406d2a11fb139cb87dfb33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:13:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.691327] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.699074] Modules linked in:\n[    4.702137] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.709882] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.719281] EIP: __flush_work+0xb8/0xd0\n[    4.723123] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.741872] EAX: 00000000 EBX: c27aee01 ECX: 00000001 EDX: 00000000\n[    4.748138] ESI: c27aeea8 EDI: c2780000 EBP: c23f3be8 ESP: c23f3b80\n[    4.754407] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    4.761198] CR0: 80050033 CR2: ffd39000 CR3: 19d58000 CR4: 003506d0\n[    4.767464] Call Trace:\n[    4.769918]  ? show_regs+0x51/0x58\n[    4.773328]  ? __flush_work+0xb8/0xd0\n[    4.776994]  ? __warn+0x8d/0x1b8\n[    4.780239]  ? __flush_work+0xb8/0xd0\n[    4.783909]  ? __flush_work+0xb8/0xd0\n[    4.787579]  ? report_bug+0x186/0x1b0\n[    4.791250]  ? __flush_work+0xb9/0xd0\n[    4.794918]  ? exc_overflow+0x50/0x50\n[    4.798588]  ? handle_bug+0x56/0x90\n[    4.802082]  ? exc_invalid_op+0x1d/0x70\n[    4.805926]  ? handle_exception+0x14b/0x14b\n[    4.810117]  ? exc_overflow+0x50/0x50\n[    4.813784]  ? __flush_work+0xb8/0xd0\n[    4.817451]  ? exc_overflow+0x50/0x50\n[    4.821121]  ? __flush_work+0xb8/0xd0\n[    4.824793]  cancel_delayed_work_sync+0x88/0x90\n[    4.829329]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    4.833867]  ? amdgpu_device_rreg+0x40/0x64\n[    4.838056]  amdgpu_ring_alloc+0x46/0x5c\n[    4.841986]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    4.847128]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    4.852618]  amdgpu_ring_test_helper+0x20/0x90\n[    4.857068]  vcn_v1_0_hw_init+0x67/0x7c\n[    4.860909]  amdgpu_device_ip_init+0x5c5/0xa74\n[    4.865359]  amdgpu_device_init+0xc4a/0x1458\n[    4.869636]  amdgpu_driver_load_kms+0x19/0x9c\n[    4.873998]  amdgpu_pci_probe+0x153/0x570\n[    4.878011]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    4.882987]  pci_device_probe+0x8c/0x118\n[    4.886914]  ? sysfs_create_link+0x1d/0x38\n[    4.891018]  really_probe+0xc2/0x2ac\n[    4.894602]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    4.898964]  ? pm_runtime_barrier+0x52/0x90\n[    4.903152]  __driver_probe_device+0x7a/0x180\n[    4.907512]  ? lock_release+0x6c/0x140\n[    4.911269]  driver_probe_device+0x23/0x108\n[    4.915459]  __driver_attach+0x97/0x188\n[    4.919299]  ? __device_attach_driver+0x120/0x120\n[    4.924007]  bus_for_each_dev+0x71/0xc0\n[    4.927848]  driver_attach+0x19/0x20\n[    4.931429]  ? __device_attach_driver+0x120/0x120\n[    4.936139]  bus_add_driver+0xc9/0x208\n[    4.939895]  driver_register+0x52/0x10c\n[    4.943737]  __pci_register_driver+0x5f/0x68\n[    4.948009]  ? drm_sched_fence_slab_init+0x80/0x80\n[    4.952806]  amdgpu_init+0x62/0xb0\n[    4.956214]  do_one_initcall+0x63/0x2a4\n[    4.960058]  ? rdinit_setup+0x40/0x40\n[    4.963729]  ? parse_args+0x14b/0x3f4\n[    4.967400]  do_initcalls+0xdc/0x218\n[    4.970980]  ? rdinit_setup+0x40/0x40\n[    4.974648]  kernel_init_freeable+0x16b/0x2bc\n[    4.979010]  ? kernel_init+0x18/0x1f4\n[    4.982678]  ? rest_init+0x1cc/0x1cc\n[    4.986264]  kernel_init+0x18/0x1f4\n[    4.989756]  ? schedule_tail+0x50/0x60\n[    4.993514]  ret_from_fork+0x38/0x44\n[    4.997097]  ? rest_init+0x1cc/0x1cc\n[    5.000681]  ret_from_fork_asm+0x12/0x18\n[    5.004607]  entry_INT80_32+0x108/0x108\n[    5.008452] irq event stamp: 859695\n[    5.011946] hardirqs last  enabled at (859705): [<d660906e>] __up_console_sem+0x52/0x58\n[    5.019949] hardirqs last disabled at (859714): [<d6609055>] __up_console_sem+0x39/0x58\n[    5.027952] softirqs last  enabled at (859672): [<d65835b2>] handle_softirqs+0x2fe/0x41c\n[    5.036041] softirqs last disabled at (859667): [<d7e8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.256152] WARNING: CPU: 1 PID: 46 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.263998] Modules linked in:\n[    8.267068] CPU: 1 UID: 0 PID: 46 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.276552] Tainted: [W]=WARN\n[    8.279546] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    8.288940] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.295393] EIP: __flush_work+0xb8/0xd0\n[    8.299241] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.318019] EAX: 00000000 EBX: c27aee01 ECX: 00000001 EDX: 00000000\n[    8.324294] ESI: c27aeea8 EDI: c2d72b7c EBP: c150dd64 ESP: c150dcfc\n[    8.330567] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.337360] CR0: 80050033 CR2: 00000000 CR3: 19d58000 CR4: 003506d0\n[    8.343647] Call Trace:\n[    8.346111]  ? show_regs+0x51/0x58\n[    8.349530]  ? __flush_work+0xb8/0xd0\n[    8.353206]  ? __warn+0x8d/0x1b8\n[    8.356448]  ? __flush_work+0xb8/0xd0\n[    8.360122]  ? __flush_work+0xb8/0xd0\n[    8.363794]  ? report_bug+0x186/0x1b0\n[    8.367470]  ? __flush_work+0xb9/0xd0\n[    8.371143]  ? exc_overflow+0x50/0x50\n[    8.374818]  ? handle_bug+0x56/0x90\n[    8.378336]  ? exc_invalid_op+0x1d/0x70\n[    8.382207]  ? handle_exception+0x14b/0x14b\n[    8.386409]  ? exc_overflow+0x50/0x50\n[    8.390086]  ? __flush_work+0xb8/0xd0\n[    8.393761]  ? exc_overflow+0x50/0x50\n[    8.397439]  ? __flush_work+0xb8/0xd0\n[    8.401123]  cancel_delayed_work_sync+0x88/0x90\n[    8.405669]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.410234]  amdgpu_ring_alloc+0x46/0x5c\n[    8.414184]  amdgpu_ib_schedule+0x14b/0x898\n[    8.418385]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.422932]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.428520]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.433499]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.438913]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.443297]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.449159]  process_one_work+0x1b9/0x6f0\n[    8.453186]  ? process_one_work+0x16c/0x6f0\n[    8.457386]  worker_thread+0x168/0x304\n[    8.461153]  kthread+0xcc/0xf4\n[    8.464220]  ? rescuer_thread+0x33c/0x33c\n[    8.468244]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.473666]  ret_from_fork+0x38/0x44\n[    8.477274]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.482686]  ret_from_fork_asm+0x12/0x18\n[    8.486627]  entry_INT80_32+0x108/0x108\n[    8.490481] irq event stamp: 21093\n[    8.493892] hardirqs last  enabled at (21127): [<d660906e>] __up_console_sem+0x52/0x58\n[    8.501818] hardirqs last disabled at (21172): [<d6609055>] __up_console_sem+0x39/0x58\n[    8.509760] softirqs last  enabled at (21218): [<d65835b2>] handle_softirqs+0x2fe/0x41c\n[    8.517786] softirqs last disabled at (21231): [<d7e8da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:85562e8fbf29166ee9e254ad565f3ddf44c4dea7', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406ff411fb139cb87e1fb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f2a036ce088e33752544c3e799b8cfb92afe7f15', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ff411fb139cb87e1fb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f2a036ce088e33752544c3e799b8cfb92afe7f15', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ff411fb139cb87e1fb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a0ce0fea3aea125e373c75fe378b26fc3bf389f9', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406ff411fb139cb87e1fb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2a11fb139cb87dfb33
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ff411fb139cb87e1fb8
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ff411fb139cb87e1fb9
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ff411fb139cb87e1fba
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aca841f41d35c6dd9a796008bffa99cc505df33d
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81a06f6eeb32a0d6d7d0c89629154a0520061a3f
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81a06f6eeb32a0d6d7d0c89629154a0520061a3f
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6c044dc1426a5c22b74591134fb2a7b65ea2c68
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85562e8fbf29166ee9e254ad565f3ddf44c4dea7
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2a036ce088e33752544c3e799b8cfb92afe7f15
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2a036ce088e33752544c3e799b8cfb92afe7f15
11/22/2024 01:13:29 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0ce0fea3aea125e373c75fe378b26fc3bf389f9
11/22/2024 01:13:29 PM UTC [INFO] Received an event for node: 67406cf111fb139cb87df9d2
11/22/2024 01:13:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf111fb139cb87df9d2
11/22/2024 01:13:30 PM UTC [INFO] Received an event for node: 67406ced11fb139cb87df9b7
11/22/2024 01:13:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ced11fb139cb87df9b7
11/22/2024 01:13:31 PM UTC [INFO] Received an event for node: 67406d1611fb139cb87dfad8
11/22/2024 01:14:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1611fb139cb87dfad8
11/22/2024 01:14:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fd0
11/22/2024 01:14:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fd9
11/22/2024 01:14:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe0
11/22/2024 01:14:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe1
11/22/2024 01:14:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe2
11/22/2024 01:14:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe3
11/22/2024 01:14:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe4
11/22/2024 01:14:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe5
11/22/2024 01:14:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe6
11/22/2024 01:14:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe7
11/22/2024 01:14:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe8
11/22/2024 01:14:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fe9
11/22/2024 01:14:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740700811fb139cb87e1fea
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1611fb139cb87dfad8
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fc8
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fc9
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fca
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fcb
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fcc
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fcd
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fce
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fcf
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd0
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd1
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd2
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd3
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd4
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd5
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd6
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd7
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd8
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fd9
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fda
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fdb
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fdc
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fdd
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fde
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fdf
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe0
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe1
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe2
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe3
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe4
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe5
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe6
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe7
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe8
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fe9
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fea
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1feb
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fec
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fed
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fee
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fef
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff0
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff1
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff2
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff3
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff4
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff5
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff6
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff7
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff8
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ff9
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ffa
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ffb
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ffc
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ffd
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1ffe
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e1fff
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2000
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2001
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2002
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2003
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2004
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2005
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2006
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2007
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2008
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2009
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200a
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200b
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200c
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200d
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200e
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e200f
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2010
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2011
11/22/2024 01:14:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740700811fb139cb87e2012
11/22/2024 01:14:09 PM UTC [INFO] Received an event for node: 67406cf511fb139cb87df9ed
11/22/2024 01:14:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf511fb139cb87df9ed
11/22/2024 01:14:11 PM UTC [INFO] Received an event for node: 67406cf411fb139cb87df9ea
11/22/2024 01:14:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf411fb139cb87df9ea
11/22/2024 01:14:12 PM UTC [INFO] Received an event for node: 67406fc711fb139cb87e1f35
11/22/2024 01:14:12 PM UTC [DEBUG] Not sending node to KCIDB: 67406fc711fb139cb87e1f35
11/22/2024 01:14:12 PM UTC [INFO] Received an event for node: 67406ceb11fb139cb87df9ab
11/22/2024 01:14:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ceb11fb139cb87df9ab
11/22/2024 01:14:13 PM UTC [INFO] Received an event for node: 67406d2a11fb139cb87dfb30
11/22/2024 01:14:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2a11fb139cb87dfb30
11/22/2024 01:14:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740701711fb139cb87e2025
11/22/2024 01:14:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2a11fb139cb87dfb30
11/22/2024 01:14:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740701711fb139cb87e2025
11/22/2024 01:14:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740701711fb139cb87e2026
11/22/2024 01:14:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740701711fb139cb87e2027
11/22/2024 01:14:17 PM UTC [INFO] Received an event for node: 67406cef11fb139cb87df9c6
11/22/2024 01:14:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cef11fb139cb87df9c6
11/22/2024 01:14:18 PM UTC [INFO] Received an event for node: 67406cf311fb139cb87df9de
11/22/2024 01:14:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf311fb139cb87df9de
11/22/2024 01:14:20 PM UTC [INFO] Received an event for node: 67406ce611fb139cb87df987
11/22/2024 01:14:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ce611fb139cb87df987
11/22/2024 01:14:21 PM UTC [INFO] Received an event for node: 67406d1711fb139cb87dfae4
11/22/2024 01:14:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1711fb139cb87dfae4
11/22/2024 01:14:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740702911fb139cb87e2042
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1711fb139cb87dfae4
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e203c
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e203d
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e203e
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e203f
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e2040
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e2041
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e2042
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e2043
11/22/2024 01:14:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740702911fb139cb87e2044
11/22/2024 01:14:27 PM UTC [INFO] Received an event for node: 67406cf411fb139cb87df9e7
11/22/2024 01:14:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf411fb139cb87df9e7
11/22/2024 01:14:28 PM UTC [INFO] Received an event for node: 674068e411fb139cb87df67c
11/22/2024 01:14:29 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e411fb139cb87df67c
11/22/2024 01:14:31 PM UTC [INFO] Received an event for node: 67406df411fb139cb87dffad
11/22/2024 01:14:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df411fb139cb87dffad
11/22/2024 01:14:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703f11fb139cb87e2068
11/22/2024 01:14:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703f11fb139cb87e2069
11/22/2024 01:14:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703f11fb139cb87e206a
11/22/2024 01:14:35 PM UTC [INFO] Received an event for node: 6740704011fb139cb87e2072
11/22/2024 01:14:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 01:14:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: k8s-all
11/22/2024 01:14:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704011fb139cb87e2072
11/22/2024 01:14:36 PM UTC [INFO] Received an event for node: 67406e8711fb139cb87e0fcc
11/22/2024 01:14:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8711fb139cb87e0fcc
11/22/2024 01:14:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704311fb139cb87e207e
11/22/2024 01:14:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704311fb139cb87e207f
11/22/2024 01:14:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704311fb139cb87e2080
11/22/2024 01:14:41 PM UTC [INFO] Received an event for node: 67406cf011fb139cb87df9cc
11/22/2024 01:14:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf011fb139cb87df9cc
11/22/2024 01:14:42 PM UTC [INFO] Received an event for node: 67406e8611fb139cb87e0fc6
11/22/2024 01:14:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8611fb139cb87e0fc6
11/22/2024 01:14:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740706b11fb139cb87e20ac
11/22/2024 01:14:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740706b11fb139cb87e20ad
11/22/2024 01:14:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740706b11fb139cb87e20ae
11/22/2024 01:14:45 PM UTC [INFO] Received an event for node: 67406df511fb139cb87dffb0
11/22/2024 01:14:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.398677] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.406597] Modules linked in:\n[    4.409658] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.420951] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.430338] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.434785] Code: 48 8b 15 c4 43 d0 63 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.453530] RSP: 0018:ffffb776c0037b60 EFLAGS: 00010246\n[    4.458758] RAX: 0000000000000000 RBX: ffff9e5487b3bd08 RCX: 0000000000000000\n[    4.465890] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb776c0037bc0\n[    4.473020] RBP: ffff9e5487b3bd08 R08: ffff9e5487b31fa0 R09: ffff9e5487ad8000\n[    4.480151] R10: 0000000000000040 R11: ffffffff9f92fd88 R12: ffff9e5487b00000\n[    4.487283] R13: ffff9e5487b34fe0 R14: ffffb776c0037b68 R15: 0000000000000001\n[    4.494416] FS:  0000000000000000(0000) GS:ffff9e55a6f00000(0000) knlGS:0000000000000000\n[    4.502501] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.508245] CR2: 0000000000000000 CR3: 00000000a6028000 CR4: 00000000003506f0\n[    4.515376] Call Trace:\n[    4.517828]  <TASK>\n[    4.519926]  ? __warn+0x85/0x130\n[    4.523163]  ? __flush_work+0x29f/0x2c0\n[    4.527004]  ? report_bug+0x160/0x190\n[    4.530673]  ? handle_bug+0x53/0x90\n[    4.534168]  ? exc_invalid_op+0x13/0x60\n[    4.538008]  ? asm_exc_invalid_op+0x16/0x20\n[    4.542196]  ? __flush_work+0x29f/0x2c0\n[    4.546038]  cancel_delayed_work_sync+0x6e/0x90\n[    4.550571]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.555108]  amdgpu_ring_alloc+0x3f/0x60\n[    4.559037]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.564178]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.568626]  amdgpu_device_init+0x205f/0x26f0\n[    4.572988]  amdgpu_driver_load_kms+0x15/0x80\n[    4.577347]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.581361]  pci_device_probe+0x98/0x120\n[    4.585289]  really_probe+0xd1/0x2b0\n[    4.588874]  ? __device_attach_driver+0xc0/0xc0\n[    4.593407]  __driver_probe_device+0x73/0x120\n[    4.597769]  driver_probe_device+0x1f/0x90\n[    4.601868]  __driver_attach+0x84/0x130\n[    4.605710]  bus_for_each_dev+0x84/0xd0\n[    4.609549]  bus_add_driver+0xe4/0x210\n[    4.613300]  driver_register+0x55/0x100\n[    4.617139]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.621933]  do_one_initcall+0x57/0x300\n[    4.625776]  kernel_init_freeable+0x1be/0x300\n[    4.630138]  ? rest_init+0xc0/0xc0\n[    4.633543]  kernel_init+0x16/0x1b0\n[    4.637036]  ret_from_fork+0x30/0x50\n[    4.640618]  ? rest_init+0xc0/0xc0\n[    4.644024]  ret_from_fork_asm+0x11/0x20\n[    4.647953]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.848857] WARNING: CPU: 3 PID: 56 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.856863] Modules linked in:\n[    4.859924] CPU: 3 UID: 0 PID: 56 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.872956] Tainted: [W]=WARN\n[    4.875931] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.885315] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.891761] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.896210] Code: 48 8b 15 c4 43 d0 63 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.914956] RSP: 0018:ffffb776c0297c58 EFLAGS: 00010246\n[    4.920182] RAX: 0000000000000000 RBX: ffff9e5487b3bd08 RCX: 0000000000000000\n[    4.927316] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb776c0297cb8\n[    4.934453] RBP: ffff9e5487b3bd08 R08: ffffb776c0297de8 R09: 0000000000000000\n[    4.941585] R10: ffffb776c0297b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.948717] R13: ffff9e5487b34fe0 R14: ffffb776c0297c60 R15: 0000000000000001\n[    4.955849] FS:  0000000000000000(0000) GS:ffff9e55a6f80000(0000) knlGS:0000000000000000\n[    4.963934] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.969682] CR2: 0000000000000000 CR3: 00000000a6028000 CR4: 00000000003506f0\n[    4.976814] Call Trace:\n[    4.979269]  <TASK>\n[    4.981379]  ? __warn+0x85/0x130\n[    4.984614]  ? __flush_work+0x29f/0x2c0\n[    4.988457]  ? report_bug+0x160/0x190\n[    4.992126]  ? handle_bug+0x53/0x90\n[    4.995621]  ? exc_invalid_op+0x13/0x60\n[    4.999464]  ? asm_exc_invalid_op+0x16/0x20\n[    5.003653]  ? __flush_work+0x29f/0x2c0\n[    5.007497]  cancel_delayed_work_sync+0x6e/0x90\n[    5.012031]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.016568]  amdgpu_ring_alloc+0x3f/0x60\n[    5.020499]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.024600]  amdgpu_job_submit_direct+0x30/0x50\n[    5.029138]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.034103]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.038466]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.044305]  process_one_work+0x18b/0x3d0\n[    5.048321]  worker_thread+0x2e4/0x420\n[    5.052072]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.056954]  ? rescuer_thread+0x5d0/0x5d0\n[    5.060967]  kthread+0xdf/0x110\n[    5.064113]  ? kthread_park+0x90/0x90\n[    5.067781]  ret_from_fork+0x30/0x50\n[    5.071365]  ? kthread_park+0x90/0x90\n[    5.075031]  ret_from_fork_asm+0x11/0x20\n[    5.078960]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9c2ea63e43011a42275abf9a64ba47611d76d1ab', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df511fb139cb87dffb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c2ea63e43011a42275abf9a64ba47611d76d1ab', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df511fb139cb87dffb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:14:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.398677] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.406597] Modules linked in:\n[    4.409658] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.420951] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.430338] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.434785] Code: 48 8b 15 c4 43 d0 63 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.453530] RSP: 0018:ffffb776c0037b60 EFLAGS: 00010246\n[    4.458758] RAX: 0000000000000000 RBX: ffff9e5487b3bd08 RCX: 0000000000000000\n[    4.465890] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb776c0037bc0\n[    4.473020] RBP: ffff9e5487b3bd08 R08: ffff9e5487b31fa0 R09: ffff9e5487ad8000\n[    4.480151] R10: 0000000000000040 R11: ffffffff9f92fd88 R12: ffff9e5487b00000\n[    4.487283] R13: ffff9e5487b34fe0 R14: ffffb776c0037b68 R15: 0000000000000001\n[    4.494416] FS:  0000000000000000(0000) GS:ffff9e55a6f00000(0000) knlGS:0000000000000000\n[    4.502501] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.508245] CR2: 0000000000000000 CR3: 00000000a6028000 CR4: 00000000003506f0\n[    4.515376] Call Trace:\n[    4.517828]  <TASK>\n[    4.519926]  ? __warn+0x85/0x130\n[    4.523163]  ? __flush_work+0x29f/0x2c0\n[    4.527004]  ? report_bug+0x160/0x190\n[    4.530673]  ? handle_bug+0x53/0x90\n[    4.534168]  ? exc_invalid_op+0x13/0x60\n[    4.538008]  ? asm_exc_invalid_op+0x16/0x20\n[    4.542196]  ? __flush_work+0x29f/0x2c0\n[    4.546038]  cancel_delayed_work_sync+0x6e/0x90\n[    4.550571]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.555108]  amdgpu_ring_alloc+0x3f/0x60\n[    4.559037]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.564178]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.568626]  amdgpu_device_init+0x205f/0x26f0\n[    4.572988]  amdgpu_driver_load_kms+0x15/0x80\n[    4.577347]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.581361]  pci_device_probe+0x98/0x120\n[    4.585289]  really_probe+0xd1/0x2b0\n[    4.588874]  ? __device_attach_driver+0xc0/0xc0\n[    4.593407]  __driver_probe_device+0x73/0x120\n[    4.597769]  driver_probe_device+0x1f/0x90\n[    4.601868]  __driver_attach+0x84/0x130\n[    4.605710]  bus_for_each_dev+0x84/0xd0\n[    4.609549]  bus_add_driver+0xe4/0x210\n[    4.613300]  driver_register+0x55/0x100\n[    4.617139]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.621933]  do_one_initcall+0x57/0x300\n[    4.625776]  kernel_init_freeable+0x1be/0x300\n[    4.630138]  ? rest_init+0xc0/0xc0\n[    4.633543]  kernel_init+0x16/0x1b0\n[    4.637036]  ret_from_fork+0x30/0x50\n[    4.640618]  ? rest_init+0xc0/0xc0\n[    4.644024]  ret_from_fork_asm+0x11/0x20\n[    4.647953]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.848857] WARNING: CPU: 3 PID: 56 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.856863] Modules linked in:\n[    4.859924] CPU: 3 UID: 0 PID: 56 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.872956] Tainted: [W]=WARN\n[    4.875931] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.885315] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.891761] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.896210] Code: 48 8b 15 c4 43 d0 63 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.914956] RSP: 0018:ffffb776c0297c58 EFLAGS: 00010246\n[    4.920182] RAX: 0000000000000000 RBX: ffff9e5487b3bd08 RCX: 0000000000000000\n[    4.927316] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb776c0297cb8\n[    4.934453] RBP: ffff9e5487b3bd08 R08: ffffb776c0297de8 R09: 0000000000000000\n[    4.941585] R10: ffffb776c0297b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.948717] R13: ffff9e5487b34fe0 R14: ffffb776c0297c60 R15: 0000000000000001\n[    4.955849] FS:  0000000000000000(0000) GS:ffff9e55a6f80000(0000) knlGS:0000000000000000\n[    4.963934] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.969682] CR2: 0000000000000000 CR3: 00000000a6028000 CR4: 00000000003506f0\n[    4.976814] Call Trace:\n[    4.979269]  <TASK>\n[    4.981379]  ? __warn+0x85/0x130\n[    4.984614]  ? __flush_work+0x29f/0x2c0\n[    4.988457]  ? report_bug+0x160/0x190\n[    4.992126]  ? handle_bug+0x53/0x90\n[    4.995621]  ? exc_invalid_op+0x13/0x60\n[    4.999464]  ? asm_exc_invalid_op+0x16/0x20\n[    5.003653]  ? __flush_work+0x29f/0x2c0\n[    5.007497]  cancel_delayed_work_sync+0x6e/0x90\n[    5.012031]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.016568]  amdgpu_ring_alloc+0x3f/0x60\n[    5.020499]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.024600]  amdgpu_job_submit_direct+0x30/0x50\n[    5.029138]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.034103]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.038466]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.044305]  process_one_work+0x18b/0x3d0\n[    5.048321]  worker_thread+0x2e4/0x420\n[    5.052072]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.056954]  ? rescuer_thread+0x5d0/0x5d0\n[    5.060967]  kthread+0xdf/0x110\n[    5.064113]  ? kthread_park+0x90/0x90\n[    5.067781]  ret_from_fork+0x30/0x50\n[    5.071365]  ? kthread_park+0x90/0x90\n[    5.075031]  ret_from_fork_asm+0x11/0x20\n[    5.078960]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:31877278d0f447795d75cc14e4b1036f1b1bb422', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:6740707211fb139cb87e20b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31877278d0f447795d75cc14e4b1036f1b1bb422', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:6740707211fb139cb87e20b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df511fb139cb87dffb0
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740707211fb139cb87e20b4
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740707211fb139cb87e20b5
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740707211fb139cb87e20b6
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c2ea63e43011a42275abf9a64ba47611d76d1ab
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c2ea63e43011a42275abf9a64ba47611d76d1ab
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31877278d0f447795d75cc14e4b1036f1b1bb422
11/22/2024 01:14:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31877278d0f447795d75cc14e4b1036f1b1bb422
11/22/2024 01:14:48 PM UTC [INFO] Received an event for node: 6740708511fb139cb87e20bb
11/22/2024 01:14:48 PM UTC [DEBUG] Not sending node to KCIDB: 6740708511fb139cb87e20bb
11/22/2024 01:14:48 PM UTC [INFO] Received an event for node: 67406cff11fb139cb87dfa32
11/22/2024 01:14:49 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406cff11fb139cb87dfa32
11/22/2024 01:14:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cff11fb139cb87dfa32
11/22/2024 01:14:49 PM UTC [INFO] Received an event for node: 6740704711fb139cb87e208f
11/22/2024 01:14:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704711fb139cb87e208f
11/22/2024 01:14:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740708711fb139cb87e20bf
11/22/2024 01:14:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740708711fb139cb87e20c0
11/22/2024 01:14:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740708711fb139cb87e20c1
11/22/2024 01:14:51 PM UTC [INFO] Received an event for node: 6740708b11fb139cb87e20c6
11/22/2024 01:14:51 PM UTC [DEBUG] Not sending node to KCIDB: 6740708b11fb139cb87e20c6
11/22/2024 01:14:51 PM UTC [INFO] Received an event for node: 67406df211fb139cb87dff10
11/22/2024 01:14:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff10
11/22/2024 01:14:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff10
11/22/2024 01:14:52 PM UTC [INFO] Received an event for node: 67406d1611fb139cb87dfadb
11/22/2024 01:15:24 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1611fb139cb87dfadb
11/22/2024 01:15:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20d2
11/22/2024 01:15:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20db
11/22/2024 01:15:25 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e2
11/22/2024 01:15:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e3
11/22/2024 01:15:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e4
11/22/2024 01:15:26 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e5
11/22/2024 01:15:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e6
11/22/2024 01:15:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e7
11/22/2024 01:15:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e8
11/22/2024 01:15:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20e9
11/22/2024 01:15:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20ea
11/22/2024 01:15:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20eb
11/22/2024 01:15:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740709d11fb139cb87e20ec
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1611fb139cb87dfadb
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ca
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20cb
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20cc
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20cd
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ce
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20cf
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d0
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d1
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d2
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d3
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d4
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d5
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d6
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d7
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d8
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20d9
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20da
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20db
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20dc
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20dd
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20de
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20df
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e0
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e1
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e2
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e3
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e4
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e5
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e6
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e7
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e8
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20e9
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ea
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20eb
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ec
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ed
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ee
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ef
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f0
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f1
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f2
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f3
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f4
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f5
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f6
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f7
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f8
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20f9
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20fa
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20fb
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20fc
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20fd
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20fe
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e20ff
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2100
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2101
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2102
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2103
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2104
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2105
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2106
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2107
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2108
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2109
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210a
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210b
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210c
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210d
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210e
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e210f
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2110
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2111
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2112
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2113
11/22/2024 01:15:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740709d11fb139cb87e2114
11/22/2024 01:15:29 PM UTC [INFO] Received an event for node: 67406cf011fb139cb87df9c9
11/22/2024 01:15:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf011fb139cb87df9c9
11/22/2024 01:15:31 PM UTC [INFO] Received an event for node: 674070a411fb139cb87e211d
11/22/2024 01:15:31 PM UTC [DEBUG] Not sending node to KCIDB: 674070a411fb139cb87e211d
11/22/2024 01:15:31 PM UTC [INFO] Received an event for node: 67406df211fb139cb87dff5b
11/22/2024 01:15:31 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5b
11/22/2024 01:15:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5b
11/22/2024 01:15:32 PM UTC [INFO] Received an event for node: 6740703d11fb139cb87e2061
11/22/2024 01:15:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703d11fb139cb87e2061
11/22/2024 01:15:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070a411fb139cb87e2124
11/22/2024 01:15:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070a411fb139cb87e2125
11/22/2024 01:15:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070a411fb139cb87e2126
11/22/2024 01:15:34 PM UTC [INFO] Received an event for node: 674070a511fb139cb87e2128
11/22/2024 01:15:34 PM UTC [DEBUG] Not sending node to KCIDB: 674070a511fb139cb87e2128
11/22/2024 01:15:34 PM UTC [INFO] Received an event for node: 67406df211fb139cb87dff5d
11/22/2024 01:15:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5d
11/22/2024 01:15:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5d
11/22/2024 01:15:35 PM UTC [INFO] Received an event for node: 674070a511fb139cb87e212b
11/22/2024 01:15:35 PM UTC [DEBUG] Not sending node to KCIDB: 674070a511fb139cb87e212b
11/22/2024 01:15:35 PM UTC [INFO] Received an event for node: 67406df211fb139cb87dff5e
11/22/2024 01:15:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df211fb139cb87dff5e
11/22/2024 01:15:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df211fb139cb87dff5e
11/22/2024 01:15:36 PM UTC [INFO] Received an event for node: 6740704611fb139cb87e208c
11/22/2024 01:15:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704611fb139cb87e208c
11/22/2024 01:15:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ab11fb139cb87e212f
11/22/2024 01:15:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ab11fb139cb87e2130
11/22/2024 01:15:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ab11fb139cb87e2131
11/22/2024 01:15:38 PM UTC [INFO] Received an event for node: 674068ee11fb139cb87df6a3
11/22/2024 01:15:39 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068ee11fb139cb87df6a3
11/22/2024 01:15:39 PM UTC [INFO] Received an event for node: 6740703c11fb139cb87e205e
11/22/2024 01:15:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703c11fb139cb87e205e
11/22/2024 01:15:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b111fb139cb87e214a
11/22/2024 01:15:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b111fb139cb87e214b
11/22/2024 01:15:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b111fb139cb87e214c
11/22/2024 01:15:42 PM UTC [INFO] Received an event for node: 6740703f11fb139cb87e2064
11/22/2024 01:15:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703f11fb139cb87e2064
11/22/2024 01:15:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b611fb139cb87e2164
11/22/2024 01:15:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b611fb139cb87e2165
11/22/2024 01:15:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b611fb139cb87e2166
11/22/2024 01:15:44 PM UTC [INFO] Received an event for node: 6740704411fb139cb87e2086
11/22/2024 01:15:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704411fb139cb87e2086
11/22/2024 01:15:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e216f
11/22/2024 01:15:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e2170
11/22/2024 01:15:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e2171
11/22/2024 01:15:46 PM UTC [INFO] Received an event for node: 6740704511fb139cb87e2089
11/22/2024 01:15:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704511fb139cb87e2089
11/22/2024 01:15:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e2177
11/22/2024 01:15:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e2178
11/22/2024 01:15:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e2179
11/22/2024 01:15:49 PM UTC [INFO] Received an event for node: 67406cf911fb139cb87dfa0b
11/22/2024 01:15:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cf911fb139cb87dfa0b
11/22/2024 01:15:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ba11fb139cb87e2182
11/22/2024 01:15:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ba11fb139cb87e2183
11/22/2024 01:15:51 PM UTC [INFO] Received an event for node: 6740703811fb139cb87e2052
11/22/2024 01:15:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703811fb139cb87e2052
11/22/2024 01:15:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bd11fb139cb87e2192
11/22/2024 01:15:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bd11fb139cb87e2193
11/22/2024 01:15:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bd11fb139cb87e2194
11/22/2024 01:15:53 PM UTC [INFO] Received an event for node: 674070c111fb139cb87e21a5
11/22/2024 01:15:53 PM UTC [DEBUG] Not sending node to KCIDB: 674070c111fb139cb87e21a5
11/22/2024 01:15:53 PM UTC [INFO] Received an event for node: 67406d0211fb139cb87dfa49
11/22/2024 01:15:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0211fb139cb87dfa49
11/22/2024 01:15:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0211fb139cb87dfa49
11/22/2024 01:15:55 PM UTC [INFO] Received an event for node: 674070c811fb139cb87e21bd
11/22/2024 01:15:55 PM UTC [DEBUG] Not sending node to KCIDB: 674070c811fb139cb87e21bd
11/22/2024 01:15:55 PM UTC [INFO] Received an event for node: 67406dff11fb139cb87dffc4
11/22/2024 01:15:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87dffc4
11/22/2024 01:15:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87dffc4
11/22/2024 01:15:56 PM UTC [INFO] Received an event for node: 6740704011fb139cb87e206f
11/22/2024 01:15:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704011fb139cb87e206f
11/22/2024 01:15:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ca11fb139cb87e21ca
11/22/2024 01:15:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ca11fb139cb87e21cb
11/22/2024 01:15:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ca11fb139cb87e21cc
11/22/2024 01:15:58 PM UTC [INFO] Received an event for node: 6740704211fb139cb87e2078
11/22/2024 01:16:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704211fb139cb87e2078
11/22/2024 01:16:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cc11fb139cb87e21d8
11/22/2024 01:16:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cc11fb139cb87e21d9
11/22/2024 01:16:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cc11fb139cb87e21da
11/22/2024 01:16:02 PM UTC [INFO] Received an event for node: 6740703a11fb139cb87e2058
11/22/2024 01:16:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703a11fb139cb87e2058
11/22/2024 01:16:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dc11fb139cb87e220d
11/22/2024 01:16:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dc11fb139cb87e220e
11/22/2024 01:16:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dc11fb139cb87e220f
11/22/2024 01:16:04 PM UTC [INFO] Received an event for node: 6740703911fb139cb87e2055
11/22/2024 01:16:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703911fb139cb87e2055
11/22/2024 01:16:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dd11fb139cb87e2218
11/22/2024 01:16:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dd11fb139cb87e2219
11/22/2024 01:16:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dd11fb139cb87e221a
11/22/2024 01:16:06 PM UTC [INFO] Received an event for node: 674070e311fb139cb87e222e
11/22/2024 01:16:06 PM UTC [DEBUG] Not sending node to KCIDB: 674070e311fb139cb87e222e
11/22/2024 01:16:06 PM UTC [INFO] Received an event for node: 67406dff11fb139cb87e000e
11/22/2024 01:16:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e000e
11/22/2024 01:16:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e000e
11/22/2024 01:16:07 PM UTC [INFO] Received an event for node: 674070e411fb139cb87e2237
11/22/2024 01:16:07 PM UTC [DEBUG] Not sending node to KCIDB: 674070e411fb139cb87e2237
11/22/2024 01:16:08 PM UTC [INFO] Received an event for node: 67406dff11fb139cb87e0010
11/22/2024 01:16:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e0010
11/22/2024 01:16:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0010
11/22/2024 01:16:08 PM UTC [INFO] Received an event for node: 674070e511fb139cb87e223a
11/22/2024 01:16:08 PM UTC [DEBUG] Not sending node to KCIDB: 674070e511fb139cb87e223a
11/22/2024 01:16:08 PM UTC [INFO] Received an event for node: 67406dff11fb139cb87e0011
11/22/2024 01:16:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dff11fb139cb87e0011
11/22/2024 01:16:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dff11fb139cb87e0011
11/22/2024 01:16:10 PM UTC [INFO] Received an event for node: 6740703b11fb139cb87e205b
11/22/2024 01:16:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703b11fb139cb87e205b
11/22/2024 01:16:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070f311fb139cb87e2257
11/22/2024 01:16:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070f311fb139cb87e2258
11/22/2024 01:16:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070f311fb139cb87e2259
11/22/2024 01:16:12 PM UTC [INFO] Received an event for node: 6740704f11fb139cb87e20a4
11/22/2024 01:16:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704f11fb139cb87e20a4
11/22/2024 01:16:14 PM UTC [INFO] Received an event for node: 674070ff11fb139cb87e2262
11/22/2024 01:16:14 PM UTC [DEBUG] Not sending node to KCIDB: 674070ff11fb139cb87e2262
11/22/2024 01:16:14 PM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa55
11/22/2024 01:16:14 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa55
11/22/2024 01:16:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa55
11/22/2024 01:16:14 PM UTC [INFO] Received an event for node: 6740710511fb139cb87e2265
11/22/2024 01:16:14 PM UTC [DEBUG] Not sending node to KCIDB: 6740710511fb139cb87e2265
11/22/2024 01:16:15 PM UTC [INFO] Received an event for node: 67406e0711fb139cb87e005f
11/22/2024 01:16:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0711fb139cb87e005f
11/22/2024 01:16:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0711fb139cb87e005f
11/22/2024 01:16:15 PM UTC [INFO] Received an event for node: 6740711d11fb139cb87e2268
11/22/2024 01:16:15 PM UTC [DEBUG] Not sending node to KCIDB: 6740711d11fb139cb87e2268
11/22/2024 01:16:15 PM UTC [INFO] Received an event for node: 67406e0811fb139cb87e00a9
11/22/2024 01:16:16 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00a9
11/22/2024 01:16:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00a9
11/22/2024 01:16:16 PM UTC [INFO] Received an event for node: 6740711f11fb139cb87e226b
11/22/2024 01:16:16 PM UTC [DEBUG] Not sending node to KCIDB: 6740711f11fb139cb87e226b
11/22/2024 01:16:16 PM UTC [INFO] Received an event for node: 67406e0811fb139cb87e00ab
11/22/2024 01:16:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00ab
11/22/2024 01:16:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ab
11/22/2024 01:16:17 PM UTC [INFO] Received an event for node: 6740711f11fb139cb87e226e
11/22/2024 01:16:17 PM UTC [DEBUG] Not sending node to KCIDB: 6740711f11fb139cb87e226e
11/22/2024 01:16:17 PM UTC [INFO] Received an event for node: 67406e0811fb139cb87e00ac
11/22/2024 01:16:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e0811fb139cb87e00ac
11/22/2024 01:16:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e0811fb139cb87e00ac
11/22/2024 01:16:18 PM UTC [INFO] Received an event for node: 6740704911fb139cb87e2095
11/22/2024 01:16:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704911fb139cb87e2095
11/22/2024 01:16:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740712611fb139cb87e2272
11/22/2024 01:16:20 PM UTC [INFO] Received an event for node: 67406d0311fb139cb87dfa4f
11/22/2024 01:17:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0311fb139cb87dfa4f
11/22/2024 01:17:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740713a11fb139cb87e22c1
11/22/2024 01:17:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740713a11fb139cb87e22c3
11/22/2024 01:17:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740713a11fb139cb87e22c4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0311fb139cb87dfa4f
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2278
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2279
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227a
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227b
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227c
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227d
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227e
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e227f
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2280
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2281
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2282
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2283
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2284
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2285
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2286
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2287
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2288
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2289
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228a
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228b
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228c
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228d
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228e
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e228f
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2290
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2291
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2292
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2293
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2294
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2295
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2296
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2297
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2298
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e2299
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229a
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229b
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229c
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229d
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229e
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e229f
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a8
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22a9
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22aa
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ab
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ac
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ad
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ae
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22af
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b8
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22b9
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ba
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22bb
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22bc
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22bd
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22be
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22bf
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c8
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22c9
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ca
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22cb
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22cc
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22cd
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ce
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22cf
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d8
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22d9
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22da
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22db
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22dc
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22dd
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22de
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22df
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e8
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22e9
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ea
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22eb
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ec
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ed
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ee
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22ef
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f0
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f1
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f2
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f3
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f4
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f5
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f6
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f7
11/22/2024 01:17:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740713a11fb139cb87e22f8
11/22/2024 01:17:19 PM UTC [INFO] Received an event for node: 6740715b11fb139cb87e22fd
11/22/2024 01:17:19 PM UTC [DEBUG] Not sending node to KCIDB: 6740715b11fb139cb87e22fd
11/22/2024 01:17:19 PM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa5b
11/22/2024 01:17:20 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa5b
11/22/2024 01:17:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa5b
11/22/2024 01:17:20 PM UTC [INFO] Received an event for node: 6740716011fb139cb87e2300
11/22/2024 01:17:20 PM UTC [DEBUG] Not sending node to KCIDB: 6740716011fb139cb87e2300
11/22/2024 01:17:20 PM UTC [INFO] Received an event for node: 67406e1611fb139cb87e0111
11/22/2024 01:17:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1611fb139cb87e0111
11/22/2024 01:17:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1611fb139cb87e0111
11/22/2024 01:17:21 PM UTC [INFO] Received an event for node: 674070ad11fb139cb87e213b
11/22/2024 01:17:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ad11fb139cb87e213b
11/22/2024 01:17:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716711fb139cb87e2304
11/22/2024 01:17:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716711fb139cb87e2305
11/22/2024 01:17:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716711fb139cb87e2306
11/22/2024 01:17:24 PM UTC [INFO] Received an event for node: 674070ac11fb139cb87e2138
11/22/2024 01:17:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ac11fb139cb87e2138
11/22/2024 01:17:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716a11fb139cb87e230c
11/22/2024 01:17:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716a11fb139cb87e230d
11/22/2024 01:17:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740716a11fb139cb87e230e
11/22/2024 01:17:27 PM UTC [INFO] Received an event for node: 6740704311fb139cb87e207b
11/22/2024 01:17:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740704311fb139cb87e207b
11/22/2024 01:17:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704311fb139cb87e207b
11/22/2024 01:17:28 PM UTC [INFO] Received an event for node: 674070af11fb139cb87e2141
11/22/2024 01:17:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070af11fb139cb87e2141
11/22/2024 01:17:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740717111fb139cb87e2318
11/22/2024 01:17:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740717111fb139cb87e2319
11/22/2024 01:17:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740717111fb139cb87e231a
11/22/2024 01:17:31 PM UTC [INFO] Received an event for node: 6740717811fb139cb87e231f
11/22/2024 01:17:31 PM UTC [DEBUG] Not sending node to KCIDB: 6740717811fb139cb87e231f
11/22/2024 01:17:31 PM UTC [INFO] Received an event for node: 67406e1711fb139cb87e015d
11/22/2024 01:17:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e015d
11/22/2024 01:17:32 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015d
11/22/2024 01:17:32 PM UTC [INFO] Received an event for node: 6740717911fb139cb87e2322
11/22/2024 01:17:32 PM UTC [DEBUG] Not sending node to KCIDB: 6740717911fb139cb87e2322
11/22/2024 01:17:32 PM UTC [INFO] Received an event for node: 67406e1711fb139cb87e015f
11/22/2024 01:17:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e015f
11/22/2024 01:17:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e015f
11/22/2024 01:17:33 PM UTC [INFO] Received an event for node: 6740717911fb139cb87e2325
11/22/2024 01:17:33 PM UTC [DEBUG] Not sending node to KCIDB: 6740717911fb139cb87e2325
11/22/2024 01:17:33 PM UTC [INFO] Received an event for node: 67406e1711fb139cb87e0160
11/22/2024 01:17:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1711fb139cb87e0160
11/22/2024 01:17:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1711fb139cb87e0160
11/22/2024 01:17:34 PM UTC [INFO] Received an event for node: 674070b311fb139cb87e2155
11/22/2024 01:17:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b311fb139cb87e2155
11/22/2024 01:17:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718311fb139cb87e2329
11/22/2024 01:17:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718311fb139cb87e232a
11/22/2024 01:17:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718311fb139cb87e232b
11/22/2024 01:17:36 PM UTC [INFO] Received an event for node: 67406d3c11fb139cb87dfbb2
11/22/2024 01:17:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3a03e3c55c4ca89a72a82a978f2ef1cf82a1f57f', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c1e553789a280a17257322f84f8a2159fb47bb8e', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31ded6c8d908a6d828e242a577ee3f2a0ecdc3d2', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3a03e3c55c4ca89a72a82a978f2ef1cf82a1f57f', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c1e553789a280a17257322f84f8a2159fb47bb8e', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31ded6c8d908a6d828e242a577ee3f2a0ecdc3d2', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3c11fb139cb87dfbb2
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a03e3c55c4ca89a72a82a978f2ef1cf82a1f57f
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1e553789a280a17257322f84f8a2159fb47bb8e
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31ded6c8d908a6d828e242a577ee3f2a0ecdc3d2
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a03e3c55c4ca89a72a82a978f2ef1cf82a1f57f
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1e553789a280a17257322f84f8a2159fb47bb8e
11/22/2024 01:17:40 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31ded6c8d908a6d828e242a577ee3f2a0ecdc3d2
11/22/2024 01:17:40 PM UTC [INFO] Received an event for node: 67406d0c11fb139cb87dfa91
11/22/2024 01:19:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b8759de6e5e33b989b65f8c23110544a3d2d9a5a', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:67406d0c11fb139cb87dfa91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c7aff642b24ff7bc9da3a6f6524546574bdf630e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e233e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:537d87643cf48cedaa550e242ba4578b270cea7a', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e233f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:306da7387075f11af6af4a86e34d8a8f2c96f6a1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2340', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8e15d92905b3d45219d3058945537bc4b594ca3d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2341', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:72be3c8db5923627882827d4ce6828f379036d1f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2342', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:352145e79f4d36683d66f321cd49090f93a64454', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2343', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f070731590c8bf9a94eaa8cfae12df15b3d92e94', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2344', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fbaa63b55980d4c97a9fd29d6d20985b548dad73', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2345', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:47fce35772ad9c8e5421813247f92188f75dfd1c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2346', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0eab10417c8faacb34e761ab2abb2fcac7e976e0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2347', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:deb5d34aa7dcae19566cec0214ca07a311b22f4f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2348', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:51a597ab4bfdf5494cc53c830df0cb58a0c8bde1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2349', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b6bcb447771f3162bf29f928ed2899f0a7006076', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:02a5e3432b28eb9b5a53101c6a35d50620c89d5d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:49c14166d60240adc850fb2638cc4c28ad6c3111', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3fdb368c8d5863dd178dbcf18502fb02de9cfa7c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:675698dde27f0dc732b4edf0e7d3f4b37365b89f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9919d8eb2f1a92b511f0baa0b5bf5f16419808c1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e234f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:28b2d87a37d4d0dd7f6001a285bb2b9e0fe79661', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2350', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:be3a4e6f12fb7abdaced1d44ecfc1d4dd0022255', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2351', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2d7ba806439fe1bdd8bf7059302bff94408d440e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2352', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:68329b0ce60b17be16b374e0e4a97870ed9bec3e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2353', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5f8310dd21a6345c3918241bad7820a4962abcd5', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2354', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cf17dd1e84321358fdde02f1716ef94dd2c8a746', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2355', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:46f348b926c2026687d9b292298743fd028d07c2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2356', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:139f0384b11f9dec76c97071f130552782b5ee51', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2357', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fb68b6f8fab515cab512909ccdd781796ea70922', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2358', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:41a885a961116a31e1e860e731ea864f7449d0b8', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2359', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:351dabf9a0fc0a3136223234ae834a3fc5bafc8e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:35be0c3807b2eb1053fd3df0309952c70897720c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:38 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:26c1edcd5c02003279841fc1f0540e9581c1b817', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a9e90a401899964f7e52293188ac95a1eb742e30', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2d9b8b9c3dff9149784c1d101e4cb398c12c47ac', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c1a34188932a1bfe7ab68db893d34165b8306086', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e235f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:39 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:15a8b2a4e892ae361c9781ad20ba87c0c1bb6b9e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2360', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d6302df715059f3a13457c90a496a698202b0f2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2361', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c1ccba231528c71fc83eee18eff87a0d0198ce9d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2362', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:40 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:71930a8eafc24b205843e4641041d4b15fe0621e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2363', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c7b1f8a2451347941a7f1c9bcd715d8f528bd2d6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2364', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a4c3db900f512335cac595228c9c9680de534d96', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2365', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1896e45df898f4473f09bb79cd97d8b500c7ee76', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2366', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:fb47b4e2b6009117dd61b5a881a3bec243d2fa62', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2367', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:780c5d792fb010501f7cd1fe53a2c993da82be53', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2368', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6ad24a7ab617b12153df3f5d93a7d3db710978fe', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2369', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:167272f387162359002a69003479330a9a06ab6d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:469a97e009a7e8ddd5242fd5fd68eaf17158efab', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1efb9e988fddde07646deff5c3f09db1cdfb9f50', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:805817560762d15ae7b3b16e94b071c3a676f9f8', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:13dfd64a455627ba7fbe3b1fcce2409eeb838c58', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5e6c1c76d6f5b342e9792eb0dbd7d268311b71e6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e236f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:44 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:89bce033fad5dfbf0ea9454f34d5964b0f158c60', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2370', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b41e9ce6084d885c5a1d8006d4e43a5ece746c23', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2371', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f83d56a412f415ee6960a17884b77f056757f71c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2372', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:45 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:84668f274c3aba2ea8647f365853ec92a955394b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2373', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5572f6b701118aeb9d6c44e8737893a34273beeb', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2374', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:938515a26de9f70dcfdb58787151c8b4861a1dbc', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2375', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:18d28efd357ee7a69bf144e187f175db68ee6017', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2376', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:25ffff9f16fbebc5a7cc10b8c48840d69a01123b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2377', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:79fd9ebe11ea84d95a2292e08aef909d5b3533d4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2378', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:91655d272cb04a95b0dd963aa0a14f104fc353f2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2379', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c3e5f361cd5394dddc7cae25dab97a309e885344', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6a107ac5621ad6a7bc288703aa4e7569bcb8518c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ecd1f4eb459bdc97297fcb6d1500d04c1fd95bdb', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:57151dac0f5aaffa917ffe6e5ac8173921f7302f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f0dd3afc70f023649f1ea368fd7d5dd09fa2833f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:734cae513225afa8909e14089cad1f9b3ba635ba', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e237f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:49 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b89b7c86ed87081e09bb9bae695af5e615661cde', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2380', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5f3918f82247dd8bf30091b7cdbb964435d9cc18', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2381', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5f16aa7893fda508a6856e225fe6250ce413503a', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2382', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:50 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bb068c38004b8068ea09276a714b8c9cbd6cd743', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2383', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0df42a5f39e03bc5dee3fac82aa56ccc75effbec', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2384', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ba5617a07b80c442564bcef81cd5c1755e899a6d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2385', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:51 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1d927f789b16a32740877a09572e82b79ccbaa82', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2386', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5fb9c8773cf1df52350220a40f874b81d25cd622', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2387', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c4c86077e13b0d460899199487da035a589486ec', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2388', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:99376a131d4367b3fe758b4b3ddc628946cfbfe2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2389', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:52 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:44ce810b63bba7ca60df9c8e34d1b2a5b3fd1ad4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1f917c09f122b8916a16e4815a797d094b13799f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5768b44883b8c3f0e3de30800ede85c162684943', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:53 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1fd5651567d0faf5d9e84a20a807a85e78d1d5a1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8bd0308d221aa5c45e69f128482ab1ada3e0aa67', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7f678a8dcbeec7aecd74716de997c463df419a96', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e238f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:54 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3b353f9b63aff7501c143c40ed65c41e1d3ad90f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2390', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:dd373d4ad9285478063edaf5200ef52b8ee7b05b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2391', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:718c3146e559bdab51d6f2461d644c7dd08cddd0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2392', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:55 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:423fd5b69c5fb20fdc7934918059d3761041edd1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2393', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:da39e8bd6ff7d1a52611fd755e9857c576379102', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2394', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3cb8fce8bd19ee82572480538ae49e29b9dba418', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2395', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:60e08b3d5692cd8d82da7883efef237319f17a99', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2396', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:245ffc73fd9c7b2334041e3b08225e1d612712ff', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2397', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8147354cc9332c5dd3793012b6698f401c59f5cc', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2398', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:943759ea6fa2116b3064d9588e517e0a1ce679e9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2399', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:57 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:086610db9225eebb985ab333419a82661118ef6b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e3f0586824d3d77d748f5f1b1630f067a0e1a59f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e51a5ebd0f796a59d78e1153cb1a79ca8dc2e161', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:58 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a0f3c2799ae79d33d2a6169f43da2eac3d402f30', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:08b92e83c03c1a121a3da3080b65f048496537dc', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3bf76b34a2584eec0b9041f173e8f3aa8e58a442', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e239f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:19:59 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3b6cc32f5a2a3fb4a9c3a2e9e406222f56623292', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6561181051e4643efd4c4745203e7d55eaf50bd1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c182e1a5d7a7f0c1bf81c0799bd609944f20c8b5', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:00 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6180449bb44073e21e6c5cbb632b8188efca887c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2919802d5b2c59e84a1908ff5ddc5f165855dc80', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:abb855da4a2259b998d924d7b729bf5531676365', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:01 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5badeebd1a02d963b88245ac5216b52660ebc2a0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:39ff0f04863bba7cd5b61ad89d073c21a7cf5025', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0a57cdc81f827d7c917dd195d612c5a4158fabe7', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:368f2c9837d3c83bb259827b2e896a30b66503d5', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:02 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:93386ae8a66e28b35e9c936e157579f7d0b60312', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:af891e74cfb5c3fb80e02564f4ce51ad7fd3b70b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b64b816dcbcfc9125de962a1c82e522ad8162e1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:95bb1a9b7c05d274d75b4ecb70fdf318ac5be7b2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:34ba3bb88d4ae5ec646327dd87fdc3b43b2b7ac0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b9438db508447d822b8a72d1518b5c18821b550', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:53ec610aa5ef032c891523e4e8155415551b79bc', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:69ea1bda5a72e27a5e8ef7437679f28485b68b88', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9031c2d66d7ea3a7588eaad1bcd887092019701b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:026df64a82799473699ccc5605eba945665caa2f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3512cdf6757859804785b26fd58abc234305869f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2808a5b3e253aff9264d220413b1dcf2663e7804', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:70f763b183b6112c02fb78e1ab7a50ef2c1494e9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9729fba296afbcf245c359823d41272626375a9e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e152efe9e945cc1f6e68fa25396560eaf797a77b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5180894cceeba444311c989dc05e3c7760036f64', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e8c68b8dec46b7ab1a26aff54e667182b4db2077', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b3706595e061ab684d2b306898b40be6db2b7b7', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:144e06112587a862ac7f615bcdd680117cbb8730', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bb27cdce3ae21fcb2ce94a51fda6cdb93c35f1f9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ae41b287e01ad75882419adc0930f748fa1186d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a6333e2707817a16b5ce8aeb0cba6466a7e9982c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f8843f57594dc5fd88730fae9550a7be99b589ec', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5824936e2377cc6aabc8e05699cc5e5e9b46b063', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:583175f3979ae48659bb8954f2c82592381d416d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c62b8c722ae059011eab80e2d1cc99d204c5fa91', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:10 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a439396ed8751391e3965b845cd5b85738da6df8', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:80d5331ccce45ddcbb8ea0dc27eb49fb82a51ce9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:44bd0b082e1b804c435dfd0c681112bf011322b0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:11 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1c8833be09a625f94ba6ad12594a101d10e96e00', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:832af5fc6e80a48322e2246a81fa73950e475fb5', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:214f0d663702b5fe9525cc09d06f63050348e9ca', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:12 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5b5f06db42a18e1748357d1c5040d5a4c328a13c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:69c846a1ee6f4c20a96a0fe4f316f37482509ed6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efceb057a48752bd3efcab724d1a887916b82485', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:13 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2f3b077494e4f02822b40a2fab69d019624f54f9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:685f00254bc2203bba4f59728e2ec78e49f757da', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b628f5584d1488eae4953aab07fc3bbe8443c606', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b024a5074496f4fc186ac6d17a260cadb8dc6129', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:14 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0d8d6dd8f659877738cc097301f29c73f0fb399b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:70749795619c81d56af4fa88c6eac4f5f6abe56d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:efd19b7fb5c2d74dd38bc5ce0e2e10704f518f14', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:15 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7426fe714e6a89929cc86865ed5e852757d05797', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:053a40bb18a05f4aca9f0d3dbb9be31d8d791dc7', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:59cceb35bcde91cf1784a1b3b598567f4fd026a6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0b892a35388557d01df2c90d8e9c4634fd577a4a', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:479eb798a7f0b89695854bd3493246fcef919d2e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:db7d6f29cf514dc3a4afa8ae11e0cef8f9b59a9c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:17 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:739bd422c2fc5a7b70837c96f9c00011f91872ad', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:52d609f1cb3e0f5f1f6ae67d22e863be6c8c7bd4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2e2f3f1493e94cdeca48147eae44708ca68a5d3f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:18 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2a9284bfb1bcbe87d294e8312959d57c7ce96b73', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f6ba958f8bdaf431a255e03b795fad43b8b19106', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6292d06185503bd0ac16d68986940fec899dac99', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f2e9728a82cfbff078718d9c3511aca06ee0a419', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:19 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ab018e33bbf7a44cc70b8ed94d31046df43b6c33', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:57bd34e8a2ca57e1d493822cbbf0c21114015720', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:bfe3ea6f5aee7633c8c63d07d38b9291bf699646', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:20 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5c06ba651ede31f530a991f789e33926ebde77d6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:74922b3fd879fa2af931602f37021c8420a2f123', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4a8effffe712e7ce0addd1600f52e1ee86866394', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:21 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:767ffc2c66b6be00f3937fc700966955d5c13961', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:375d73a235abc4f6ca7d69810f7591ecfe24710b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:de0c00cd473f0e1f5c9e06083976d85bf001d6bc', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:524cfc71b84a16c2672819570c49e3708dba03cb', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:94ab4b517037603cc4a5467a175251ab85be5ab5', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:28b2e3728cf8bcb89d03bb017013aaca445459d6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c93112a31338d3cded3d6b2ed32dbe0647bd87f6', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:23 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5c9dd01a9d28a1ab7d3055e25b8fceea2acaa047', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7ff1147db15900ac853d57ff4ce424d5d8f5d6fa', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ff30333c6aea1ba999c2c4e136b6f36ceca4c2b0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f54c973e201537802eed183182e9a981a1d72f2c', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:2f60cef00bf4cc7bf3d047d6fdb5dfbdd55d185d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d5cc529a3a9b001bcfe4a09ff365c527eaaef693', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:25 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f5bd0a0156ca9d64c53c17fdbbc9211cc1fd8594', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:094f9247c6423d4c289e1dd6324edbaf975c753b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e84c9e1c1fb4e7f727110d99136e198a3e66b325', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:26 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b5fefcde66dd1d996780244a3d497907c3b497d4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8790524223601732cc0f6d9dd446be5cad24b99d', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f312121c7400dc5e2325f6ab90796b341c3f62af', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:101cb61e1eda691847a4c651f053d56acdd27220', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:3cfce5dc22f35852f37af56360de2a093dc39db4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6c172789b438ddf3641036caa4058a2e45de5ad4', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f17d5819e87b8c4fba2af443e3680f4132c13bf1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:28 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0bf5c18a9be955312518baa45d76eed03cda4de9', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c54b306b1fa248b9c00538041b400561194205d7', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e23ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:76081db819033ef4904db6564ec928f2a8cf54ef', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2400', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:29 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d61da652fb80ee02b47c6bd47318e3f869fd6de2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2401', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a3c263f39f0c41a05a5575e4d6aa088f0b702708', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2402', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f867f25578842b81d07f144f4d24b8f0529f2481', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2403', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:30 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:426be3210bfc241458e79adca887a5a006cf1a76', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2404', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:11cad491ca410fb23970abd2696f268b7d212734', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2405', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d2cb0a686bbcbe30c054483ccf49e44554ac103b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2406', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:31 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:662961974159d30b9a8b2071b05291123f468312', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2407', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c80c1118cfe2b6f9f45a5bfc127c07e77ef9aeeb', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2408', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a42041bf3e6408300cac4a5390bb9183767eba6b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2409', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:9092ad4c57ae9f0c40b16bd39e1ba047f003ca89', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:32 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:e6d79f6ea231d42d9a80c0c2922ca17811274e38', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a950c0183eafa43210d62df9188e679f9b526a71', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ea6764cb03f7144e8ff505be645f261232fa1c90', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:8341993442fe7cb1f02abdf69935240c145cb8a1', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:4b99095111a5ff47abb2af4fd8d05015fcc889db', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e240f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:a28201bac88a4449c87a781d2456df326e38b2e0', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2410', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:34 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cb9371a234d3f6e0813348fe6ecf0e9059f2237f', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2411', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5adc986363088807edafc2a84f8bce818c0ebaf2', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2412', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:82ee2a431152d375cea006ac749e309c1d62b39e', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2413', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:1db1b0a430b69e2d45154a8b9f02d3f7d584029b', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2414', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d567b9c3cf540c2188284f30893a3f3c43615322', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2415', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:23a97306d2a52c9a8718e85ce4ab2b5d2f644659', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2416', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:36 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'hardware': 'Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __alloc_pages_noprof+0xf9c/0xff0', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __alloc_pages_noprof+0xf9c/0xff0', '? io_schedule_timeout+0x4c/0x70', '? __wait_for_common+0x15c/0x190', '? __pfx_io_schedule_timeout+0x10/0x10', '? __kmalloc_noprof+0x2e0/0x3d0', '? __blk_mq_free_request+0xb1/0xe0', '__dma_direct_alloc_pages.constprop.0+0x130/0x240', 'dma_direct_alloc_pages+0x1b/0xb0', 'dma_alloc_noncontiguous+0xb5/0x200', 'nvme_setup_host_mem+0x48f/0x550', '? __wake_up+0x3f/0x60', 'nvme_probe+0x774/0x910', 'local_pci_probe+0x3a/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xc9/0x2b0', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach_async_helper+0x4e/0xa0', 'async_run_entry_fn+0x1c/0xa0', 'process_one_work+0x160/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xc8/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2c/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.053358] ahci 0000:00:17.0: 1/1 ports implemented (port mask 0x1)\n[    4.058519] WARNING: CPU: 1 PID: 11 at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0\n[    4.065628] ahci 0000:00:17.0: flags: 64bit ncq sntf pm clo only pio slum part deso sadm sds apst\n[    4.075049] Modules linked in:\n[    4.075052] CPU: 1 UID: 0 PID: 11 Comm: kworker/u8:0 Not tainted 6.12.0-next-20241122 #1\n[    4.085278] scsi host0: ahci\n[    4.088476] Hardware name: Dell Inc. Sarien/Sarien, BIOS Google_Sarien.12105.121.0 04/19/2019\n[    4.088478] Workqueue: async async_run_entry_fn\n[    4.088484] RIP: 0010:__alloc_pages_noprof+0xf9c/0xff0\n[    4.088489] Code: da ff ff 48 85 c0 0f 85 8d fd ff ff e8 1d 6b 40 01 44 89 f0 25 00 00 08 00 89 44 24 20 e9 f8 f4 ff ff c6 05 a8 6a 67 03 01 90 <0f> 0b 90 e9 01 f3 ff ff 90 0f 0b 90 e9 79 fe ff ff 90 0f 0b 90 e9\n[    4.097620] ata1: SATA max UDMA/133 abar m2048@0xd134e000 port 0xd134e100 irq 124 lpm-pol 4\n[    4.100745] RSP: 0018:ffffa49c8006bb08 EFLAGS: 00010246\n[    4.100748] RAX: 0000000000000000 RBX: ffff8901409ad0c0 RCX: 0000000000000000\n[    4.100749] RDX: 0000000000000000 RSI: 000000000000000e RDI: 0000000000000cc0\n[    4.100751] RBP: 0000000000000000 R08: 0000000000000cc0 R09: 0000000000000000\n[    4.100752] R10: ffff890140a8fda0 R11: 0000000002000000 R12: 000000000000000e\n[    4.110581] e100: Intel(R) PRO/100 Network Driver\n[    4.115341] R13: 00000000ffffffff R14: 0000000003ffffff R15: 000000000000000e\n[    4.115343] FS:  0000000000000000(0000) GS:ffff8901aa500000(0000) knlGS:0000000000000000\n[    4.115346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.121084] e100: Copyright(c) 1999-2006 Intel Corporation\n[    4.142060] CR2: 00007f0c721c0160 CR3: 000000005e02e001 CR4: 00000000003706f0\n[    4.151426] e1000: Intel(R) PRO/1000 Network Driver\n[    4.157225] Call Trace:\n[    4.157227]  <TASK>\n[    4.157229]  ? __warn+0x84/0x130\n[    4.165203] e1000: Copyright (c) 1999-2006 Intel Corporation.\n[    4.173164]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.181136] e1000e: Intel(R) PRO/1000 Network Driver\n[    4.189096]  ? report_bug+0x164/0x190\n[    4.194338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.\n[    4.202307]  ? handle_bug+0x54/0x90\n[    4.211530] e1000e 0000:00:1f.6: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode\n[    4.217760]  ? exc_invalid_op+0x17/0x70\n[    4.217763]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.296851]  ? __alloc_pages_noprof+0xf9c/0xff0\n[    4.301911]  ? io_schedule_timeout+0x4c/0x70\n[    4.306678]  ? __wait_for_common+0x15c/0x190\n[    4.311446]  ? __pfx_io_schedule_timeout+0x10/0x10\n[    4.316796]  ? __kmalloc_noprof+0x2e0/0x3d0\n[    4.321466]  ? __blk_mq_free_request+0xb1/0xe0\n[    4.326430]  __dma_direct_alloc_pages.constprop.0+0x130/0x240\n[    4.332849]  dma_direct_alloc_pages+0x1b/0xb0\n[    4.337712]  dma_alloc_noncontiguous+0xb5/0x200\n[    4.342772]  nvme_setup_host_mem+0x48f/0x550\n[    4.347540]  ? __wake_up+0x3f/0x60\n[    4.351337]  nvme_probe+0x774/0x910\n[    4.355230]  local_pci_probe+0x3a/0x90\n[    4.359417]  pci_device_probe+0xb5/0x180\n[    4.363796]  really_probe+0xc9/0x2b0\n[    4.367787]  __driver_probe_device+0x6e/0x110\n[    4.372653]  driver_probe_device+0x1a/0xe0\n[    4.377225]  __driver_attach_async_helper+0x4e/0xa0\n[    4.382674]  async_run_entry_fn+0x1c/0xa0\n[    4.387150]  process_one_work+0x160/0x390\n[    4.391627]  worker_thread+0x2a0/0x3b0\n[    4.395813]  ? __pfx_worker_thread+0x10/0x10\n[    4.400580]  kthread+0xc8/0xf0\n[    4.403989]  ? __pfx_kthread+0x10/0x10\n[    4.408174]  ret_from_fork+0x2c/0x50\n[    4.409464] e1000e 0000:00:1f.6 0000:00:1f.6 (uninitialized): registered PHC clock\n[    4.412167]  ? __pfx_kthread+0x10/0x10\n[    4.412169]  ret_from_fork_asm+0x1a/0x30\n[    4.412173]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0', 'location': 'mm/page_alloc.c:4763 __alloc_pages_noprof+0xf9c/0xff0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b983ebef57466ba5cc1e5a1fe8392322d5a20b97', 'issue_id': 'maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d', 'issue_version': 0, 'test_id': 'maestro:6740718b11fb139cb87e2417', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0c11fb139cb87dfa91
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2335
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2336
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2337
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2338
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2339
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e233f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2340
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2341
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2342
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2343
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2344
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2345
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2346
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2347
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2348
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2349
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e234f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2350
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2351
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2352
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2353
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2354
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2355
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2356
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2357
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2358
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2359
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e235f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2360
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2361
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2362
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2363
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2364
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2365
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2366
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2367
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2368
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2369
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e236f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2370
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2371
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2372
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2373
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2374
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2375
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2376
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2377
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2378
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2379
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e237f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2380
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2381
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2382
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2383
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2384
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2385
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2386
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2387
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2388
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2389
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e238f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2390
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2391
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2392
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2393
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2394
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2395
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2396
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2397
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2398
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2399
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e239f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23a9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23aa
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ab
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ac
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ad
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ae
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23af
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23b9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ba
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23bb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23bc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23bd
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23be
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23bf
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23c9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ca
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23cb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23cc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23cd
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ce
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23cf
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23d9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23da
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23db
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23dc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23dd
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23de
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23df
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23e9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ea
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23eb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ec
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ed
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ee
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ef
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f3
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23f9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23fa
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23fb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23fc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23fd
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23fe
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e23ff
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2400
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2401
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2402
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2403
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2404
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2405
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2406
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2407
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2408
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2409
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e240f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2410
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2411
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2412
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2413
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2414
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2415
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2416
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2417
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718b11fb139cb87e2418
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:8d19ac5ee6b8d259bd4c75b11724a59cd7f4ac3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8759de6e5e33b989b65f8c23110544a3d2d9a5a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7aff642b24ff7bc9da3a6f6524546574bdf630e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:537d87643cf48cedaa550e242ba4578b270cea7a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:306da7387075f11af6af4a86e34d8a8f2c96f6a1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e15d92905b3d45219d3058945537bc4b594ca3d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72be3c8db5923627882827d4ce6828f379036d1f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:352145e79f4d36683d66f321cd49090f93a64454
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f070731590c8bf9a94eaa8cfae12df15b3d92e94
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fbaa63b55980d4c97a9fd29d6d20985b548dad73
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47fce35772ad9c8e5421813247f92188f75dfd1c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0eab10417c8faacb34e761ab2abb2fcac7e976e0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:deb5d34aa7dcae19566cec0214ca07a311b22f4f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:51a597ab4bfdf5494cc53c830df0cb58a0c8bde1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6bcb447771f3162bf29f928ed2899f0a7006076
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:02a5e3432b28eb9b5a53101c6a35d50620c89d5d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:49c14166d60240adc850fb2638cc4c28ad6c3111
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fdb368c8d5863dd178dbcf18502fb02de9cfa7c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:675698dde27f0dc732b4edf0e7d3f4b37365b89f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9919d8eb2f1a92b511f0baa0b5bf5f16419808c1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28b2d87a37d4d0dd7f6001a285bb2b9e0fe79661
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be3a4e6f12fb7abdaced1d44ecfc1d4dd0022255
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d7ba806439fe1bdd8bf7059302bff94408d440e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68329b0ce60b17be16b374e0e4a97870ed9bec3e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f8310dd21a6345c3918241bad7820a4962abcd5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf17dd1e84321358fdde02f1716ef94dd2c8a746
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46f348b926c2026687d9b292298743fd028d07c2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:139f0384b11f9dec76c97071f130552782b5ee51
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb68b6f8fab515cab512909ccdd781796ea70922
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41a885a961116a31e1e860e731ea864f7449d0b8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:351dabf9a0fc0a3136223234ae834a3fc5bafc8e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35be0c3807b2eb1053fd3df0309952c70897720c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26c1edcd5c02003279841fc1f0540e9581c1b817
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9e90a401899964f7e52293188ac95a1eb742e30
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d9b8b9c3dff9149784c1d101e4cb398c12c47ac
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1a34188932a1bfe7ab68db893d34165b8306086
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:15a8b2a4e892ae361c9781ad20ba87c0c1bb6b9e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d6302df715059f3a13457c90a496a698202b0f2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1ccba231528c71fc83eee18eff87a0d0198ce9d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71930a8eafc24b205843e4641041d4b15fe0621e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7b1f8a2451347941a7f1c9bcd715d8f528bd2d6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4c3db900f512335cac595228c9c9680de534d96
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1896e45df898f4473f09bb79cd97d8b500c7ee76
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb47b4e2b6009117dd61b5a881a3bec243d2fa62
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:780c5d792fb010501f7cd1fe53a2c993da82be53
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ad24a7ab617b12153df3f5d93a7d3db710978fe
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:167272f387162359002a69003479330a9a06ab6d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:469a97e009a7e8ddd5242fd5fd68eaf17158efab
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1efb9e988fddde07646deff5c3f09db1cdfb9f50
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:805817560762d15ae7b3b16e94b071c3a676f9f8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13dfd64a455627ba7fbe3b1fcce2409eeb838c58
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e6c1c76d6f5b342e9792eb0dbd7d268311b71e6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89bce033fad5dfbf0ea9454f34d5964b0f158c60
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b41e9ce6084d885c5a1d8006d4e43a5ece746c23
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f83d56a412f415ee6960a17884b77f056757f71c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84668f274c3aba2ea8647f365853ec92a955394b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5572f6b701118aeb9d6c44e8737893a34273beeb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:938515a26de9f70dcfdb58787151c8b4861a1dbc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18d28efd357ee7a69bf144e187f175db68ee6017
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:25ffff9f16fbebc5a7cc10b8c48840d69a01123b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:79fd9ebe11ea84d95a2292e08aef909d5b3533d4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91655d272cb04a95b0dd963aa0a14f104fc353f2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3e5f361cd5394dddc7cae25dab97a309e885344
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a107ac5621ad6a7bc288703aa4e7569bcb8518c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ecd1f4eb459bdc97297fcb6d1500d04c1fd95bdb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57151dac0f5aaffa917ffe6e5ac8173921f7302f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0dd3afc70f023649f1ea368fd7d5dd09fa2833f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:734cae513225afa8909e14089cad1f9b3ba635ba
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b89b7c86ed87081e09bb9bae695af5e615661cde
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f3918f82247dd8bf30091b7cdbb964435d9cc18
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f16aa7893fda508a6856e225fe6250ce413503a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb068c38004b8068ea09276a714b8c9cbd6cd743
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0df42a5f39e03bc5dee3fac82aa56ccc75effbec
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba5617a07b80c442564bcef81cd5c1755e899a6d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d927f789b16a32740877a09572e82b79ccbaa82
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fb9c8773cf1df52350220a40f874b81d25cd622
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4c86077e13b0d460899199487da035a589486ec
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99376a131d4367b3fe758b4b3ddc628946cfbfe2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44ce810b63bba7ca60df9c8e34d1b2a5b3fd1ad4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f917c09f122b8916a16e4815a797d094b13799f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5768b44883b8c3f0e3de30800ede85c162684943
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1fd5651567d0faf5d9e84a20a807a85e78d1d5a1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8bd0308d221aa5c45e69f128482ab1ada3e0aa67
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f678a8dcbeec7aecd74716de997c463df419a96
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b353f9b63aff7501c143c40ed65c41e1d3ad90f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd373d4ad9285478063edaf5200ef52b8ee7b05b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:718c3146e559bdab51d6f2461d644c7dd08cddd0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:423fd5b69c5fb20fdc7934918059d3761041edd1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da39e8bd6ff7d1a52611fd755e9857c576379102
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cb8fce8bd19ee82572480538ae49e29b9dba418
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60e08b3d5692cd8d82da7883efef237319f17a99
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:245ffc73fd9c7b2334041e3b08225e1d612712ff
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8147354cc9332c5dd3793012b6698f401c59f5cc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:943759ea6fa2116b3064d9588e517e0a1ce679e9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:086610db9225eebb985ab333419a82661118ef6b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3f0586824d3d77d748f5f1b1630f067a0e1a59f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e51a5ebd0f796a59d78e1153cb1a79ca8dc2e161
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0f3c2799ae79d33d2a6169f43da2eac3d402f30
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08b92e83c03c1a121a3da3080b65f048496537dc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3bf76b34a2584eec0b9041f173e8f3aa8e58a442
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b6cc32f5a2a3fb4a9c3a2e9e406222f56623292
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6561181051e4643efd4c4745203e7d55eaf50bd1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c182e1a5d7a7f0c1bf81c0799bd609944f20c8b5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6180449bb44073e21e6c5cbb632b8188efca887c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2919802d5b2c59e84a1908ff5ddc5f165855dc80
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abb855da4a2259b998d924d7b729bf5531676365
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5badeebd1a02d963b88245ac5216b52660ebc2a0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39ff0f04863bba7cd5b61ad89d073c21a7cf5025
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0a57cdc81f827d7c917dd195d612c5a4158fabe7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:368f2c9837d3c83bb259827b2e896a30b66503d5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93386ae8a66e28b35e9c936e157579f7d0b60312
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af891e74cfb5c3fb80e02564f4ce51ad7fd3b70b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b64b816dcbcfc9125de962a1c82e522ad8162e1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95bb1a9b7c05d274d75b4ecb70fdf318ac5be7b2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34ba3bb88d4ae5ec646327dd87fdc3b43b2b7ac0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b9438db508447d822b8a72d1518b5c18821b550
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53ec610aa5ef032c891523e4e8155415551b79bc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69ea1bda5a72e27a5e8ef7437679f28485b68b88
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9031c2d66d7ea3a7588eaad1bcd887092019701b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:026df64a82799473699ccc5605eba945665caa2f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3512cdf6757859804785b26fd58abc234305869f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2808a5b3e253aff9264d220413b1dcf2663e7804
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70f763b183b6112c02fb78e1ab7a50ef2c1494e9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9729fba296afbcf245c359823d41272626375a9e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e152efe9e945cc1f6e68fa25396560eaf797a77b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5180894cceeba444311c989dc05e3c7760036f64
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8c68b8dec46b7ab1a26aff54e667182b4db2077
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b3706595e061ab684d2b306898b40be6db2b7b7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:144e06112587a862ac7f615bcdd680117cbb8730
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb27cdce3ae21fcb2ce94a51fda6cdb93c35f1f9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ae41b287e01ad75882419adc0930f748fa1186d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6333e2707817a16b5ce8aeb0cba6466a7e9982c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8843f57594dc5fd88730fae9550a7be99b589ec
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5824936e2377cc6aabc8e05699cc5e5e9b46b063
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:583175f3979ae48659bb8954f2c82592381d416d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c62b8c722ae059011eab80e2d1cc99d204c5fa91
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a439396ed8751391e3965b845cd5b85738da6df8
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:80d5331ccce45ddcbb8ea0dc27eb49fb82a51ce9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44bd0b082e1b804c435dfd0c681112bf011322b0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c8833be09a625f94ba6ad12594a101d10e96e00
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:832af5fc6e80a48322e2246a81fa73950e475fb5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:214f0d663702b5fe9525cc09d06f63050348e9ca
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b5f06db42a18e1748357d1c5040d5a4c328a13c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69c846a1ee6f4c20a96a0fe4f316f37482509ed6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efceb057a48752bd3efcab724d1a887916b82485
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f3b077494e4f02822b40a2fab69d019624f54f9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:685f00254bc2203bba4f59728e2ec78e49f757da
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b628f5584d1488eae4953aab07fc3bbe8443c606
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b024a5074496f4fc186ac6d17a260cadb8dc6129
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d8d6dd8f659877738cc097301f29c73f0fb399b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70749795619c81d56af4fa88c6eac4f5f6abe56d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efd19b7fb5c2d74dd38bc5ce0e2e10704f518f14
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7426fe714e6a89929cc86865ed5e852757d05797
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:053a40bb18a05f4aca9f0d3dbb9be31d8d791dc7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59cceb35bcde91cf1784a1b3b598567f4fd026a6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b892a35388557d01df2c90d8e9c4634fd577a4a
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:479eb798a7f0b89695854bd3493246fcef919d2e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db7d6f29cf514dc3a4afa8ae11e0cef8f9b59a9c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:739bd422c2fc5a7b70837c96f9c00011f91872ad
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d609f1cb3e0f5f1f6ae67d22e863be6c8c7bd4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2e2f3f1493e94cdeca48147eae44708ca68a5d3f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a9284bfb1bcbe87d294e8312959d57c7ce96b73
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6ba958f8bdaf431a255e03b795fad43b8b19106
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6292d06185503bd0ac16d68986940fec899dac99
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2e9728a82cfbff078718d9c3511aca06ee0a419
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab018e33bbf7a44cc70b8ed94d31046df43b6c33
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57bd34e8a2ca57e1d493822cbbf0c21114015720
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bfe3ea6f5aee7633c8c63d07d38b9291bf699646
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c06ba651ede31f530a991f789e33926ebde77d6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:74922b3fd879fa2af931602f37021c8420a2f123
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a8effffe712e7ce0addd1600f52e1ee86866394
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:767ffc2c66b6be00f3937fc700966955d5c13961
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:375d73a235abc4f6ca7d69810f7591ecfe24710b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de0c00cd473f0e1f5c9e06083976d85bf001d6bc
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:524cfc71b84a16c2672819570c49e3708dba03cb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:94ab4b517037603cc4a5467a175251ab85be5ab5
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28b2e3728cf8bcb89d03bb017013aaca445459d6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c93112a31338d3cded3d6b2ed32dbe0647bd87f6
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c9dd01a9d28a1ab7d3055e25b8fceea2acaa047
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ff1147db15900ac853d57ff4ce424d5d8f5d6fa
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff30333c6aea1ba999c2c4e136b6f36ceca4c2b0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f54c973e201537802eed183182e9a981a1d72f2c
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f60cef00bf4cc7bf3d047d6fdb5dfbdd55d185d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d5cc529a3a9b001bcfe4a09ff365c527eaaef693
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5bd0a0156ca9d64c53c17fdbbc9211cc1fd8594
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:094f9247c6423d4c289e1dd6324edbaf975c753b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e84c9e1c1fb4e7f727110d99136e198a3e66b325
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5fefcde66dd1d996780244a3d497907c3b497d4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8790524223601732cc0f6d9dd446be5cad24b99d
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f312121c7400dc5e2325f6ab90796b341c3f62af
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:101cb61e1eda691847a4c651f053d56acdd27220
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cfce5dc22f35852f37af56360de2a093dc39db4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c172789b438ddf3641036caa4058a2e45de5ad4
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f17d5819e87b8c4fba2af443e3680f4132c13bf1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0bf5c18a9be955312518baa45d76eed03cda4de9
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c54b306b1fa248b9c00538041b400561194205d7
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:76081db819033ef4904db6564ec928f2a8cf54ef
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d61da652fb80ee02b47c6bd47318e3f869fd6de2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3c263f39f0c41a05a5575e4d6aa088f0b702708
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f867f25578842b81d07f144f4d24b8f0529f2481
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:426be3210bfc241458e79adca887a5a006cf1a76
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11cad491ca410fb23970abd2696f268b7d212734
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2cb0a686bbcbe30c054483ccf49e44554ac103b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:662961974159d30b9a8b2071b05291123f468312
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c80c1118cfe2b6f9f45a5bfc127c07e77ef9aeeb
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a42041bf3e6408300cac4a5390bb9183767eba6b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9092ad4c57ae9f0c40b16bd39e1ba047f003ca89
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e6d79f6ea231d42d9a80c0c2922ca17811274e38
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a950c0183eafa43210d62df9188e679f9b526a71
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea6764cb03f7144e8ff505be645f261232fa1c90
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8341993442fe7cb1f02abdf69935240c145cb8a1
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b99095111a5ff47abb2af4fd8d05015fcc889db
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a28201bac88a4449c87a781d2456df326e38b2e0
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb9371a234d3f6e0813348fe6ecf0e9059f2237f
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5adc986363088807edafc2a84f8bce818c0ebaf2
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82ee2a431152d375cea006ac749e309c1d62b39e
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1db1b0a430b69e2d45154a8b9f02d3f7d584029b
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d567b9c3cf540c2188284f30893a3f3c43615322
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23a97306d2a52c9a8718e85ce4ab2b5d2f644659
11/22/2024 01:20:36 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b983ebef57466ba5cc1e5a1fe8392322d5a20b97
11/22/2024 01:20:37 PM UTC [INFO] Received an event for node: 674070b011fb139cb87e2144
11/22/2024 01:20:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b011fb139cb87e2144
11/22/2024 01:20:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718f11fb139cb87e241e
11/22/2024 01:20:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718f11fb139cb87e241f
11/22/2024 01:20:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740718f11fb139cb87e2420
11/22/2024 01:20:39 PM UTC [INFO] Received an event for node: 674070b211fb139cb87e2152
11/22/2024 01:20:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b211fb139cb87e2152
11/22/2024 01:20:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719011fb139cb87e2426
11/22/2024 01:20:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719011fb139cb87e2427
11/22/2024 01:20:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719011fb139cb87e2428
11/22/2024 01:20:42 PM UTC [INFO] Received an event for node: 674070b411fb139cb87e2158
11/22/2024 01:20:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b411fb139cb87e2158
11/22/2024 01:20:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719911fb139cb87e242e
11/22/2024 01:20:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719911fb139cb87e242f
11/22/2024 01:20:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719911fb139cb87e2430
11/22/2024 01:20:45 PM UTC [INFO] Received an event for node: 674070b611fb139cb87e2160
11/22/2024 01:20:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b611fb139cb87e2160
11/22/2024 01:20:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719f11fb139cb87e2436
11/22/2024 01:20:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719f11fb139cb87e2437
11/22/2024 01:20:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740719f11fb139cb87e2438
11/22/2024 01:20:48 PM UTC [INFO] Received an event for node: 674070ae11fb139cb87e213e
11/22/2024 01:20:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ae11fb139cb87e213e
11/22/2024 01:20:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071a211fb139cb87e243e
11/22/2024 01:20:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071a211fb139cb87e243f
11/22/2024 01:20:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071a211fb139cb87e2440
11/22/2024 01:20:51 PM UTC [INFO] Received an event for node: 674070c611fb139cb87e21b5
11/22/2024 01:20:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c611fb139cb87e21b5
11/22/2024 01:20:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c211fb139cb87e2446
11/22/2024 01:20:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c211fb139cb87e2447
11/22/2024 01:20:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c211fb139cb87e2448
11/22/2024 01:20:53 PM UTC [INFO] Received an event for node: 674070c811fb139cb87e21c1
11/22/2024 01:20:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c811fb139cb87e21c1
11/22/2024 01:20:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c211fb139cb87e244e
11/22/2024 01:20:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c211fb139cb87e244f
11/22/2024 01:20:55 PM UTC [INFO] Received an event for node: 674070be11fb139cb87e219d
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070be11fb139cb87e219d
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c311fb139cb87e2455
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c311fb139cb87e2456
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c311fb139cb87e2457
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c311fb139cb87e2458
11/22/2024 01:20:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c311fb139cb87e2459
11/22/2024 01:20:59 PM UTC [INFO] Received an event for node: 674070d411fb139cb87e21f5
11/22/2024 01:21:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d411fb139cb87e21f5
11/22/2024 01:21:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c611fb139cb87e245f
11/22/2024 01:21:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071c611fb139cb87e2460
11/22/2024 01:21:01 PM UTC [INFO] Received an event for node: 6740704111fb139cb87e2075
11/22/2024 01:21:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740704111fb139cb87e2075
11/22/2024 01:21:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704111fb139cb87e2075
11/22/2024 01:21:02 PM UTC [INFO] Received an event for node: 674070bf11fb139cb87e21a0
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bf11fb139cb87e21a0
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246a
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246b
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246c
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246d
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246e
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e246f
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e2470
11/22/2024 01:21:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e2471
11/22/2024 01:21:07 PM UTC [INFO] Received an event for node: 674070c311fb139cb87e21ac
11/22/2024 01:21:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c311fb139cb87e21ac
11/22/2024 01:21:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e2477
11/22/2024 01:21:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e2478
11/22/2024 01:21:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e511fb139cb87e2479
11/22/2024 01:21:10 PM UTC [INFO] Received an event for node: 674070cb11fb139cb87e21d2
11/22/2024 01:21:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cb11fb139cb87e21d2
11/22/2024 01:21:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e811fb139cb87e247f
11/22/2024 01:21:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071e811fb139cb87e2480
11/22/2024 01:21:12 PM UTC [INFO] Received an event for node: 674070b911fb139cb87e217f
11/22/2024 01:22:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3702644fe8e52f33673976b00311390883d319fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b911fb139cb87e217f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:918977521ab05b6be29ada2cc59cf1dc817ba4c7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b911fb139cb87e217f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1c19a9de52df21cc57431f27959844fd7405088b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e2486', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc2494f632cae7ba65854155e1ac38e67d32b45c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e2486', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:457b78ef9313ba196551b30fabcbff99caf22506', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e248b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8d4791f228ef5008fbd76773d15bb37a6ca824a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e248b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a07cf2bc3465c9946b413af97b53987ae2efaf96', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f2409d131280e36fcd6e0531d5385919e8c0879', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3dae5ac16e4fa91ed4beaa1ed362852dd5e0eeff', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10d3e66482b1b4193be7cf8f536746930a18f95b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7c9755f6894e8b6a889b35281dae48c2aa25fb9c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d2ec3e30a566dd43d8dbf5e7282da435e720873d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ed11fb139cb87e24d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b911fb139cb87e217f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2486
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2487
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2488
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2489
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248d
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248e
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e248f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2490
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2491
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2492
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2493
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2494
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2495
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2496
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2497
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2498
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2499
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249d
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249e
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e249f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24a9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24aa
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ab
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ac
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ad
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ae
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24af
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24b9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ba
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24bb
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24bc
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24bd
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24be
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24bf
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24c9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ca
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24cb
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24cc
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24cd
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ce
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24cf
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24d9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24da
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24db
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24dc
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24dd
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24de
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24df
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24e9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ea
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24eb
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ec
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ed
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ee
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ef
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f0
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f1
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f2
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f3
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f4
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f5
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f6
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f8
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24f9
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24fa
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24fb
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24fc
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24fd
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24fe
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e24ff
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2500
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2501
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2502
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2503
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2504
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2505
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2506
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2507
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2508
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2509
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250d
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250e
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e250f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2510
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2511
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2512
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2513
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2514
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2515
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2516
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2517
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2518
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2519
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251d
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251e
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e251f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2520
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2521
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2522
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2523
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2524
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2525
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2526
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2527
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2528
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2529
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252d
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252e
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e252f
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2530
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ed11fb139cb87e2531
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3702644fe8e52f33673976b00311390883d319fe
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:918977521ab05b6be29ada2cc59cf1dc817ba4c7
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c19a9de52df21cc57431f27959844fd7405088b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc2494f632cae7ba65854155e1ac38e67d32b45c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:457b78ef9313ba196551b30fabcbff99caf22506
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8d4791f228ef5008fbd76773d15bb37a6ca824a
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a07cf2bc3465c9946b413af97b53987ae2efaf96
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f2409d131280e36fcd6e0531d5385919e8c0879
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3dae5ac16e4fa91ed4beaa1ed362852dd5e0eeff
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10d3e66482b1b4193be7cf8f536746930a18f95b
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c9755f6894e8b6a889b35281dae48c2aa25fb9c
11/22/2024 01:22:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2ec3e30a566dd43d8dbf5e7282da435e720873d
11/22/2024 01:22:14 PM UTC [INFO] Received an event for node: 674070d711fb139cb87e21fe
11/22/2024 01:22:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d711fb139cb87e21fe
11/22/2024 01:22:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ef11fb139cb87e2537
11/22/2024 01:22:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ef11fb139cb87e2538
11/22/2024 01:22:16 PM UTC [INFO] Received an event for node: 674070bc11fb139cb87e218f
11/22/2024 01:23:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ce69317c70f06da835969131ebbb510d9d24ed00', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070bc11fb139cb87e218f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e9fefd948453bdf4d4586245d1fd4a9c606aeb1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070bc11fb139cb87e218f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:23:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b613abb3ca838551e05449a69ca226953150172b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e2561', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6879a4d01732c0befae7fc09aeeb93e687456195', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e2561', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:23:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a9ca894cba72f519797ae02765690c07dd972507', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e2580', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0ed2be53064fbd69213b5098d32417e0677ce607', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e2580', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:23:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:49d4372222602078d03466322f37bf594979b851', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e25be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4c21545f4ef71a77a5e023370f5b148785d9eaf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674071ff11fb139cb87e25be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bc11fb139cb87e218f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e253e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e253f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2540
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2541
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2542
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2543
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2544
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2545
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2546
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2547
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2548
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2549
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e254f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2550
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2551
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2552
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2553
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2554
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2555
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2556
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2557
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2558
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2559
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e255f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2560
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2561
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2562
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2563
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2564
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2565
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2566
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2567
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2568
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2569
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e256f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2570
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2571
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2572
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2573
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2574
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2575
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2576
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2577
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2578
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2579
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e257f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2580
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2581
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2582
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2583
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2584
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2585
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2586
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2587
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2588
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2589
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e258f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2590
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2591
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2592
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2593
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2594
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2595
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2596
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2597
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2598
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2599
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259a
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259c
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259d
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259e
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e259f
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25a9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25aa
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ab
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ac
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ad
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ae
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25af
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25b9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ba
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25bb
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25bc
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25bd
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25be
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25bf
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25c9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ca
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25cb
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25cc
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25cd
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ce
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25cf
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25d9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25da
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25db
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25dc
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25dd
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25de
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25df
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25e9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ea
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25eb
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ec
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ed
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ee
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ef
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f0
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f2
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f3
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f4
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f5
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f6
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f7
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f8
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25f9
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25fa
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25fb
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25fc
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25fd
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25fe
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e25ff
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674071ff11fb139cb87e2600
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce69317c70f06da835969131ebbb510d9d24ed00
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e9fefd948453bdf4d4586245d1fd4a9c606aeb1
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b613abb3ca838551e05449a69ca226953150172b
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6879a4d01732c0befae7fc09aeeb93e687456195
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9ca894cba72f519797ae02765690c07dd972507
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ed2be53064fbd69213b5098d32417e0677ce607
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:49d4372222602078d03466322f37bf594979b851
11/22/2024 01:23:30 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4c21545f4ef71a77a5e023370f5b148785d9eaf
11/22/2024 01:23:31 PM UTC [INFO] Received an event for node: 674070de11fb139cb87e2220
11/22/2024 01:24:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f18cb9f937c86a90c54d8a36c4a2aaa49fe02622', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070de11fb139cb87e2220', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:232fc56dd60aab3e01897e0e9e5ada8d7099e249', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070de11fb139cb87e2220', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:24:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0ebc987e56bcb03b7b78731a5ab293eb141616d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e264f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e4dd4651961efc0c90e1a1d1158495b2f6f76ef8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e264f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:24:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7b5ce0ae59daa2a85e46892cab9604bb152775d9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2651', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2d2bb8ae042931840ef64e7ad801ebc248240732', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2651', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:24:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c77115576d2cc3d9def50df8e15b4e45c521392', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2652', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:485201f2f5244fedd5206976ebe52ecf28e60dbd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2652', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070de11fb139cb87e2220
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2606
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2607
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2608
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2609
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e260f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2610
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2611
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2612
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2613
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2614
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2615
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2616
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2617
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2618
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2619
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e261f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2620
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2621
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2622
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2623
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2624
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2625
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2626
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2627
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2628
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2629
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e262f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2630
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2631
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2632
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2633
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2634
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2635
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2636
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2637
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2638
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2639
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e263f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2640
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2641
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2642
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2643
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2644
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2645
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2646
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2647
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2648
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2649
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2650
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2651
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2652
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2653
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2654
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2655
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2656
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2657
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2658
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2659
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e265f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2660
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2661
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2662
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2663
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2664
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2665
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2666
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2667
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2668
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2669
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e266f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2670
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2671
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2672
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2673
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2674
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2675
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2676
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2677
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2678
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2679
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267a
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267b
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267c
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267d
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267e
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e267f
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2680
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2681
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2682
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2683
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2684
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2685
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2686
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f18cb9f937c86a90c54d8a36c4a2aaa49fe02622
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:232fc56dd60aab3e01897e0e9e5ada8d7099e249
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ebc987e56bcb03b7b78731a5ab293eb141616d5
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e4dd4651961efc0c90e1a1d1158495b2f6f76ef8
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b5ce0ae59daa2a85e46892cab9604bb152775d9
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d2bb8ae042931840ef64e7ad801ebc248240732
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c77115576d2cc3d9def50df8e15b4e45c521392
11/22/2024 01:24:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:485201f2f5244fedd5206976ebe52ecf28e60dbd
11/22/2024 01:24:28 PM UTC [INFO] Received an event for node: 67406d2d11fb139cb87dfb42
11/22/2024 01:24:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2d11fb139cb87dfb42
11/22/2024 01:24:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2d11fb139cb87dfb42
11/22/2024 01:24:30 PM UTC [INFO] Received an event for node: 674070b811fb139cb87e217c
11/22/2024 01:25:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:722497f36531ccbc035d0fc9f7c29a37168c65c7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b811fb139cb87e217c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9eb8a4f29e3980976ddef0ee81efdf0b7c244d6c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b811fb139cb87e217c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:25:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ae94aa1ec3ef205e59438532f6b7624a11283d41', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e2690', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3632117118866698b117bf72268b240c19d62f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e2690', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:25:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:565b8b1b01a0ed5c8f3d6a24c8b6f2418056bbed', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e26b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f3d090ef2e7b9382da478c8512254b5a9cf28498', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e26b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:25:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7008d0e1e809b2bd5d4617f214b7c1e79e26bcc2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e26ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f231c42b41cd69333b83b5f86ccd3af37cb71a5a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740721311fb139cb87e26ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b811fb139cb87e217c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2690
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2691
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2692
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2693
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2694
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2695
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2696
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2697
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2698
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2699
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269a
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269b
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269d
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269e
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e269f
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26a9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26aa
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ab
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ac
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ad
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ae
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26af
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26b9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ba
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26bb
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26bc
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26bd
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26be
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26bf
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26c9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ca
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26cb
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26cc
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26cd
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ce
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26cf
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26d9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26da
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26db
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26dc
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26dd
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26de
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26df
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26e9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ea
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26eb
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ec
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ed
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ee
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ef
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f0
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f1
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f3
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f4
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f5
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f8
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26f9
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26fa
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26fb
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26fc
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26fd
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26fe
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e26ff
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2700
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2701
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2702
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2703
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2704
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2705
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2706
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2707
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2708
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2709
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270a
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270b
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270d
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270e
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e270f
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2710
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2711
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2712
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2713
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2714
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2715
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2716
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2717
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2718
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2719
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271a
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271b
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271d
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271e
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e271f
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2720
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2721
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2722
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2723
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2724
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2725
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2726
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2727
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2728
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2729
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272a
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272b
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272d
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272e
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e272f
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2730
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2731
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2732
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2733
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721311fb139cb87e2734
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:722497f36531ccbc035d0fc9f7c29a37168c65c7
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9eb8a4f29e3980976ddef0ee81efdf0b7c244d6c
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ae94aa1ec3ef205e59438532f6b7624a11283d41
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3632117118866698b117bf72268b240c19d62f6
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:565b8b1b01a0ed5c8f3d6a24c8b6f2418056bbed
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f3d090ef2e7b9382da478c8512254b5a9cf28498
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7008d0e1e809b2bd5d4617f214b7c1e79e26bcc2
11/22/2024 01:25:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f231c42b41cd69333b83b5f86ccd3af37cb71a5a
11/22/2024 01:25:34 PM UTC [INFO] Received an event for node: 674070d111fb139cb87e21ec
11/22/2024 01:25:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d111fb139cb87e21ec
11/22/2024 01:25:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721411fb139cb87e273a
11/22/2024 01:25:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721411fb139cb87e273b
11/22/2024 01:25:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740721411fb139cb87e273c
11/22/2024 01:25:36 PM UTC [INFO] Received an event for node: 674070eb11fb139cb87e224d
11/22/2024 01:25:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070eb11fb139cb87e224d
11/22/2024 01:25:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740722b11fb139cb87e2742
11/22/2024 01:25:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740722b11fb139cb87e2743
11/22/2024 01:25:38 PM UTC [INFO] Received an event for node: 674070c411fb139cb87e21b2
11/22/2024 01:25:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c411fb139cb87e21b2
11/22/2024 01:25:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740723811fb139cb87e2749
11/22/2024 01:25:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740723811fb139cb87e274a
11/22/2024 01:25:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740723811fb139cb87e274b
11/22/2024 01:25:41 PM UTC [INFO] Received an event for node: 67406d2c11fb139cb87dfb3f
11/22/2024 01:25:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2c11fb139cb87dfb3f
11/22/2024 01:25:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2c11fb139cb87dfb3f
11/22/2024 01:25:43 PM UTC [INFO] Received an event for node: 674070ec11fb139cb87e2250
11/22/2024 01:25:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ec11fb139cb87e2250
11/22/2024 01:25:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740724311fb139cb87e2755
11/22/2024 01:25:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740724311fb139cb87e2756
11/22/2024 01:25:45 PM UTC [INFO] Received an event for node: 67406d2e11fb139cb87dfb50
11/22/2024 01:25:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2e11fb139cb87dfb50
11/22/2024 01:25:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2e11fb139cb87dfb50
11/22/2024 01:25:47 PM UTC [INFO] Received an event for node: 674070e911fb139cb87e2247
11/22/2024 01:25:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e911fb139cb87e2247
11/22/2024 01:25:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740724c11fb139cb87e2760
11/22/2024 01:25:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740724c11fb139cb87e2761
11/22/2024 01:25:50 PM UTC [INFO] Received an event for node: 6740704b11fb139cb87e209b
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704b11fb139cb87e209b
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e2767
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e2768
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e2769
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276a
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276b
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276c
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276d
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276e
11/22/2024 01:25:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725411fb139cb87e276f
11/22/2024 01:25:54 PM UTC [INFO] Received an event for node: 674070e411fb139cb87e2235
11/22/2024 01:27:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9f402a9189f61f7fd7ac8780adabe0d024825f5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070e411fb139cb87e2235', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f04f0f0ef9b1f18e6515d39da239efb786c773c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070e411fb139cb87e2235', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:507c2b2e13c82f3b0c1a342c96d10b7ac4c83119', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e277e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9138c02694fc4d9339933fe5836cfd92670bd41f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e277e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:31babd5a7f2f7179621218690915acdcd2cfa4c0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e277f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64cd29f87b1a7c9cbca086085d2b7d6d83244905', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e277f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a32bfecdc7a8c2b1dd6d85458d6ef882387be67e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2780', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9f88117ba9d5c536c664c96b1fb4914295e557c9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2780', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:85b84194a7c356e841998fac096bd76a7e93ff6f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2781', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9229a86db61801566c3b82932cf6d40ab1fa83a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2781', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:64ac513dd8b5b474655a07bbfec23e942c3b9a9e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2782', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0dd162b8338b5e3620cd53098cfc423f587697d1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2782', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2346045322a9475e72459dfe9e103579e79de7d1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2783', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64b0391b72ea2237be80d3ad9ae25121ac3953b1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2783', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:512ac7199df581d248b34093e173d0aa4f5c16ae', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2784', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:132efe39dcf6a9412fed77f8598fc33e5a9c80b2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2784', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d6b6c1d03f986e923a67764a3e09168f2e90567e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2785', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4e8f8c339f801936b75005d1e8a4581efe4e8189', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2785', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:496dc815864d8f8519b8a09923a0d0868f8ca0e8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2786', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dad03325564212346e0dc63948746c8c89ea7eab', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2786', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:59fe0dfae1ae77903067a169833af96c45acaaf7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2787', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0ad2a30880c457eaa1d7ba11153db5c21124845c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2787', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d89d102c15259161b4cbce808e683406597ff366', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2788', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de9df11e69543070edfa476ae08c64342d49bc06', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2788', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dda0f4cc331879a1758da5c1221e40bef26e7421', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2789', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c38996e2fcaeaa7b26bf996ea2295bf3fe39f627', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2789', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e51f129f60a945c2307b8a509cbd3131d29406fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e52beaf86bb203adf935be27b5c41df0cbcf92d7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:97970ea2f9d8e58cb46c0519dab90429bcf0213d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:671422fa1269acbd65d9e77c003ae8eb51b21116', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:86d35b35c96a7c2d9ae9b5b4ad78ab295d24208e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64dc994b392d4e4c27f1a6055df048d3447f25ac', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0312f0f59baaa7d03742703bf834dd74d45c3301', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d880f8e7a4ed7ad6a34b9ffc44099704c02fb2b8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ef426214daa74ef5f9ccba4269ea73bd6dc40f5b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d6a246e567ca0337b3962d9fe25cbda36ca7f7d3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2b247fec16cd537fd90976ad425459c1dc858292', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee748b2c8ae9822657b7281a64d6e3462b524faf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e278f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b3bb035bdeea2abdb92991a3b214d276a99b6d79', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2790', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7591c3b1618fc610965d035cbe82165ccf548e8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2790', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54e9d8fb1c6248ae2158fb6f53d2666b3ce74158', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2791', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5bfa0558c0dcf0a28874d765b9f0c0fb19bb8724', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2791', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:429d89378f63bbf8ff7b85174ea96075bb6a77ed', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2792', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:82b3f8debdb13730a135e6f876c6063a749713a6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2792', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fb3f5b0eebf650e7f71574137ff699ffa4972051', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2793', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a1e130e84af68c6c4d8bcbdda143ecae9237c1d0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2793', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:16d93c8e6513dbb94750db84cc3f3863edf3bfee', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2794', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:45902be3474ffda45a4da43b357c955063d344df', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2794', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6f60626c9fa202c31885c47d249282b48e8eb41e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2795', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:099eed215e37d7f86c03f25274893afe465b3029', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2795', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:476a7d6eb29be92349427f9d9f7d7db9018e6980', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2796', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:042b9f2adc6278869fcdabc4e5061ffa3af9a713', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2796', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d70e993f787129769c9418ae61e2772dd532e20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2797', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7825a65d20afa3452615aaf254747296c5d673d5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2797', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9639a09a847faa8f1706cf942569f78497f45f57', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2798', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c9a547c736b158edec41939898d6fbae94e8ec27', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2798', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:963e9191e9f5d4d3c062676ab72781db82fd2d3d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2799', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3feecafd1d33fec56f1d6149142b4b7282ace68d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e2799', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9961ab527e743bec44dade7102dc30bca11c5abb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:765b0d6f4046220cfecac2e0c1fac6c630895bce', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:701a69551279e0ae3dbe6b2217ac567107fb16f9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59efee663f88ada9d8a26159b52fcd89532c9be4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:27:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:92bccc18fe14ae758bc0abd8b99e0bdc636e4b5b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a13e723f7884d9e7535462383d44ad34bc7286e4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:985718ca31de083c47ee9d41c60876287f881015', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30294de87e2942abb95482b5254deff300433404', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7703256eff8334141ce689e7639528a15180247a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:497868566cad8333a4f875c53c008021fd0e8201', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fec1f10a4ade78e7071fc2b54721af009d6929a9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66d5da59d70e72c2890e92d4758f4dc3704217aa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e279f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb65b5c3c87268d15e83f84aca9117882b57a4d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6affff79677e1991b5aa772298a359d6aecb21df', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0b3be04846d6234080b5dbd5a8b7a6333e10bc0b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:06212b5d6cc90c5e206213666bdeca84c133f2ce', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1a573c2ae4edd9c1c9d58dbd5c55be9820bd83c2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18319ff87c69cef7e2058a981690ba62a4b1d144', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:95e37eeb238b4838e6c11039be6776ef174fd028', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd45e9005834c5bfcbf2a54fa778a848885b51fa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:56146bcc78e8185afce6bff3091198a3f63f7c85', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:035cbebc8e1c6cb57230348ba2fad167f0c41f4f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8a61f5d458bd3a5afe2abb93ea8ac6d75ad6216f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a551ff0d6494dddb8119dffa09da1076f4f5cc1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:88df9d32d8d1f433987fc4ab4610d59abd926d8f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:45db212be4cb6a1bdf11976e00996c6f10e24e6f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9678a36e6a35e3ac9a92f62318ba989ed7864eab', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c6a44a5d79df0f93f36a5710a6ec2ad86b45b814', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6aed1169cc8cdea588fafec8c47f54a2af4a5a26', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a117809ae6122ee90d1a3270082ee556ee80020', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4e960091e2737515deb6692ab0cc5cee84926c9c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd4dc8859cc2e6cec8c895895393005d1388325c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:801a9834964c6925dab84c63af69e7848d9d41cb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:25d5c409d6c210dab1e9ed5758e37f19a1bcc5a9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:89a99a81cc5bd201c7efb8fb6c2ae6cdbda54118', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c634cd91c4b72075ad72fe61e30079b425c3bac8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:75144bd5c53e1057e8e60b71f563ec89413dd3c2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e8fc1bc4140ea659ca4139033227bc27f241f92c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ad20100d44097b73484052ba297eea466c4aea28', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0bf466db2046d44793c2cb9b4cabe616d42c983d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6ba3fbe9885896be6c35463d03dc5322349e5c72', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72adf0b912f23e4c0972073451ba5ed2486012a8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb2512ad736eac6c52010f5c110cdd3cecd2b261', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:32c1844a0c16d87d6581bb47dc5695d0926eb761', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:14287ae684fb9ab20045d3c92d6cdc3443386d73', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:19637c7ab3cd8a0651c21a80b9ecf3f12b37786d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3cbb1f4d097a962ca1e1f3db9f2b670c63700f97', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b9528344dabde02ea4bad0cc358147e1f41ab203', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2d1a358aa80971fe747ab6057af716d58a14dcbb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c36add7ae6170fe2ddff9d7917ae7907d2fbc4e1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:af702d47d1c157fdcbd5192a00e6526810a3a860', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2493088693a26e68b4421983db0873cc56bcdb34', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cf2a8aa838c094c42981cb13c7ee2a4ce19a74d9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30b0f7b2698b665c87ba76bf9148e285795808b9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d6c4d94bcfa7831c23a94379281ab96f7ebce563', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c26fddde8f54608a570324d424ce30569b96ce55', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f516f609d87d593f9995a1e6dc881d89f0c427c8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ed0a5364d561b9b1ea419b50c0432874be9ffb56', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6c326ece77a70bc1e8d6bdab69f9e1937e9992a2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bc3ea8733a5bda38d883cbb819dbbcccb41aff00', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bd764dd6565f0ee0c3dc8f7cff7da58d1877c390', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0d4f44d1bfee54637949c87f1eab9417d3bef40b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb0e7df77c0231cf7b99a092469ef442e2c72719', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:70840ad4d72d81b6aa1fdf86f6341a549e6b3902', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3bb809d8170d306bac97f3cb583097b8c3960fce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:16edda1f6a9f481149339a07e4caa7ff2b0ca5b5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:82d821ae89c6eb8b74f08f6a70ee6c7ffb7207cb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a8a7e1be2f327ed62c98e270ecf8580983b1a31', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:78d02fac20c4246cddca4922539e34017679f0eb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:91a6173c8272c67802441df26989524a48a83af5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3058400f69d3a0b8d6f483743cc888eed3ed98bf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:310f539cc6800ddae4177df7ec3ca6b995a76402', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2e65c05a3dbca4efdd8ac45b1afebb3f06ccc8a9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9e4a945dd27d17c7ba1d405757e117af835f1739', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:23f5e1b1376e5cceb0f8beb6a88b65f2411b3e23', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bcfa8f2336dcfb1352293cab91ce38c8f5549ef8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1ee9c9c87da55f78723691929d0dc29ca640c09f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1fc5dbfbb4aac20befac4adfc4016a70d01c46fb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:72372d8fbe1b6911c21e337bfc26ab5eda6beb52', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0b0d428cd2f2497cdf6f76f8a38f6414422237be', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3ca3b6f6565e4ea6fb1760b4696a0294f1bd3690', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c30874393f962f4a129eb6092bc20c8f25158f39', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a57cf6bf755b7d3b3f738d7867e9a604ea58acce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1b154ce3ff9aababa1aa703a7522509842b523e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:427ce5c7375044d7d3a322f7ecf75500dda9daeb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ed7c354e120988aec305610fbf7a2964e42b59f3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0f034eab8c2244e6b7a38e23d5cb1c8dc8ad8f63', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2526d81fcc4a236376e6eed4674cd86cf6b1e886', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f68c2e3e30333575ad9c6b0a479fda88e2590db5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:083a2147d8338dc43bbf7b1fc1fb7348a032bf1e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a93cd018ecedbd455c06e9da166107aecc423891', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c1fa84748088ce1c93fd6372bba1c18beb3d40f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ddfb3894142596d74a0dc85ec05e8a2a86900b81', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:87a0a3e1f4a9dfa3f7928514227db6e4cb9fd8b8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4cf672dccc6d32465b874fdf3f0839fec7056b77', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e68a467cf2a3821e9cb609b725938607af899da7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:34717f79cc495dfc710a4de48aef63876002e524', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:66acf438e114b7bf3f01bb5ec105c8e2a4b95dda', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5155eeaf5cfb9837bad33d5215b153dd107598c3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:205aca4d2f5b123f4e8674ce3084453aad6ffe9e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:eb33ddd1fd3033944bc46ef2286ac47fbe2569cb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:14970c00d18eb599b1e364b52c55b2e50f3b27cb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c615421fce468a055adcabe23170a4b2ddadea8c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f40f6eaa72cfb88efd0fba705175b5a1f3ae1c74', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:20fdc63c04c96ef721aed749a51ffe55547cf8d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8b0e3b6c31010d49159d62dae71beebebd48808b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:792afe2741a6e9af9272c2ff3bfae1c05ec3791b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc227ce0034803efa1622179cf0d9f4a75e6c7c2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:eacd90cdcd346bb0b7652b6571fefe72a601d824', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0f8d06700723c86a49ccfdbf59d9426b89e2cf20', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7c371dfd9a033399bb899ec1455edd197c0c7d35', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac946850785dc19f6c79e84560490f93fd31d1a6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ff7240f699bf76edc870dd7e684c613a3c6e3339', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93e94961238a0ed2fb172810bfe0bb1a1c646d31', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:62c6514d1237ef98d8f3036ba9edceffbb90e8ad', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:afca1d6f88db9e015cddd5bdd79ec19cc38c7218', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9af492f826820b5e886cda869953c36ecd6bcc36', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:86589b0b3d8bfcf46e4de260804f092eb1d113d0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3899d9839ddfa5e5b99f06c9d6520fed60c01e42', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:000dc42989bc5a56ca7f5edc1fbef5ab8502fd74', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:63d134cc361c7fb24404f5c38a4df0c778fbdaed', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8fcd4c69517f8b7a54df6ea31d4f8589415a63dc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3805d88d709a4361dba00207ad8a1d61d22d68ca', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a583d4624f50f5d38d6f1c1cfd1d7ac68d3cff3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c87124a92b19ec4cc0fd41fefe7b6cdd300c2ecc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:12771aef3e524d43d003621fde3ef071241206fb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e2144fd5a4d428863fb5a15536600f6e6cd5396b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fb6a4f1e7eac2c81f578237cd84fab9132e8a499', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:23f776f49d7708525fac983b9e719ee38af3673f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:92c2b9a6c58767716ec67385f283eb8277e71f7e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0715a7196082d0d27ebb39e59c16952826015eaf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d38d87b5a69d445a22c4d90b39acedabfdebd8a9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:600d2592c0dc7bdb4005af43b8d30ff529040c77', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:08a262b383908ba867525c44b7aa6e7c5964b578', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:605aea4b4204194ce3f38b3b2147aad707205514', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a893515088824cb3e8682501164ca9646492605', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:acda7115d188aa905c02e4885afd00b64c1e47cd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b129258acb0cf812fed9e7fa2eafc6f4ce43138c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:229352bbc2ace5a599ddb28efd7d558615723f3f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f88b6b1d857f7ee2e59aa23a0988d47c8290ae31', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ef4e5d63578a15f0c363ecb07610c6834200069b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:509bfc2f6266b2baf65217543314a01e7d0cb98d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9c271ffbb73ab7b477d6215c6c61f3cc7bd7bcf7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e2f240bedeb5af91d83ece6372724b1fd7893d4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:809037539d92741f8ba53e7f9007a112adb00447', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ba0ce8340c1d2876b07a1cc8de2e645e82e677a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a509e8437b80eea275136bedf154657981971533', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c5ea92c7c3d9809b1303dff297a018ca379db19b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:26f9ee8eed72db72b042b588bb0fa783c8dd60bb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:48576c6ff7622173d3a9b02e359110775b564c92', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:40f4e1c82de022e04fd7179042d28d9e1d82543a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c87976d7cccc522d31192768c3b1194eb0ea4df6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7eb1c3ca208d7d60384397ef6e894753c0fa77a2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ba0f54e5c9f5b3fff46cfb4ea4b9574d3d482e41', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aefbacf7b1a8afda14b1f142f268b1cef7b69d9d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c9117c98b79e8731e8d10b0ee69d55dc20cd549a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7dba233498f3bc154b6d04ea14d7443c4d6ffb16', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1efb8e9153a60753374d0846fb6c4d7ac1c62e47', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3b04ea3761da9dbf8f9e8a75b63e811bcb51b2c3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b6ee062643f39267db77229fabc0a51fbadb71d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27e9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aea23e1ff0cb81efddec5124326c2b8216dd4af9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e457253dccb623b18932858beaadd6382c2a40f3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:630bce4187c644ee57b41dde0878980a94c41461', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:caeb60d3b6f2fc60ffce704f1f15bd14027e5d05', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27eb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:22a7846cd06618c49af9dec0d6d1f947e59f5848', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e8efa2d4422cb9e97f5618b1e840fb1bd4cc284', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fdc94925c406712ae36ef903e2a37eb27ebd4c74', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e08e65fb78a90e4bbb5f3f8493768290807d8780', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4a91282f67da897176bdaa24118e4ec4d44ade40', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4377a90fb8271f6273421af4f409af7995202861', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bd303527dff472fc8f172a5a62f40fa89ef69e4c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa0b14f1876cfd3972e971773261670a78270ac4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27ef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6ebd16646e1eac8ab7d3921e34a0d659abd815d6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3e6c90bae2406f4450d7b083721a183a49590db9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:281967ef13fed8da86fafb5ed74c2095626fd15a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d37a1bc9c363a7e43d3ba341714f48976af98f41', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3c82d8ed6f4aca58d1b790499c327c868e0f2d0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0fac962090919eeffe63c70f61ed2398ec3238b9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ca42a566bdbfc31a43f75f23df13d1b1cab7dc67', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3dcf30557c441253fac245c2f45c0dbcc340b3a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:273dd976890630d319f649d4a93842f16461907e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3540241c83e8191eac39f300b1be241b5432e0e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:185daf24f9e77fa1607ef3841638fe01ad68a4fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:af56a78cb8da5c5e5c41b7eb4c5b732aae81984e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f5dc26426af0771a5e353a65e69ff4dab5dc9199', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cdf2c0544bfe4a567618ccebc6712daeb7029370', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0384697cc49bb3ec50f95f30d0cc14dc0df50675', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:656ffab18f62714d5549c5d2a0ebe8ea03f9a0ea', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8552a21a00e9381b766f0d97388f24f63d533bab', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:17782abafcb8fde2f9b14bf28dd8ce46ba57e6cd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:31e2309faa21cfb56256792542ddbb1fb633cb44', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8347f04b3d5b5b1c8fc2942696cc7cd4f4c50319', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27f9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e96df341c77dfbb0056a22cf8eca39a623fed97a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a440ecbbdb1dc074cae6f24b6f23fb597792cfdb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27fa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3c54f03f0e6dc713ad4121ae488a0a5eacbc5edc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:05c4a51848023a02699ebc83638bff5b60e4d17f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725811fb139cb87e27fb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8e0f4178c06ae12b44e13fc30d5228dae71dacee', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:19398f4bad4bad2dc04f02c5c9ebd403f9cc4a8b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3ce94767d3a3af3b9612c9bfb4f78c17b244cf93', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a8bba550e55e183a0665ee8e1c680dbc3280c050', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8652a058c5b1547943d6662991fa6ae0c783879f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:451b107f1e8955280ab7edcda0f448920b839cb5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27fe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e4dc010758bde4c0b5aaa117b18956ff01cf635a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3b7ae1912355c274d92f58eb060e6630b8c92a4a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e27ff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6667a9613e7b1c3b77f2fe15536d15634778778e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2800', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:422f1c0bcf8998f27d4a8888dc0e748594a1ce90', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2800', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4d6a1e813470ece1f847eb8544e3c570689781b9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2801', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e81df593f8badca53403395ae0968bdcb24a216d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2801', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:34fc3908b6dc6aa894c31e45aaf4505e1a0b5c1e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2802', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cb591177df1fd13ac55be3fceb0339afb1332021', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2802', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:21d5d07197625fd84302c94151caed121c4c4c40', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2803', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4bd85c607561813311e772d7371fb35c49d3b27b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2803', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cf9901eb377f3fbb0a8522717105c12ec7c647e6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2804', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63efb9400f5b2eeb75a4f76d040b8630fe528ff0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2804', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:47e029b3ed4d17481abe245504159f39108cb8db', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2805', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:710b58e13904ac3c1fd964053424932cae053b51', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2805', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4a8e29e261aa25700e3c434fe8566d32f827afc5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2806', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:498bc2cd01c69c1e1d464ce6da9f2ab76164b120', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2806', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:11e001b866795ae4745b55cd51005d814d01cbc6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2807', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a142d9d60a371f0bd2e483fee300a6d6547c7bd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2807', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a1f7d74135270558574fad66400cdb368dce1f8f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2808', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2442cddce2618a718c63d843383d208362791ed9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2808', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:67163dc3104e25e453d4e649282b49fb1c2880de', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2809', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bcd5054bfc034dad84f5bc9c85c9ffd3835d9305', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2809', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb291647565ae853b64aeea775764d5e45022fc6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5044e0f630a4ddfe3fbd7b3e232420c7c41615f9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2b707051e9f4b9768bce6900b09994932bce2216', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a6c7212568a473359cd11f8c46aab8c4bd29d7af', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:569c56d3418698b648c8f26e39436bdb58f0fcbf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:824d2ca6caa2eb31d67e050febb6da6916b005a3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a2a05215d5c2e695bfac5e0a8fc821875ea8278e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e456c3320a28120387f71403a5d29d791458035c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:99519091aace4dd07aa371bbf4b223849f1cf227', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1bb6a6473c7718893609252d0db9e2c0d6095c3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f00f910445c374f660cfbebe4af7f0500658ee6d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cadf2b84ad0768ad919ea059c8b9ec1edaa3297d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e280f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b92f2950d9f77fa482e5b7842c4485da6ef9d76e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2810', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b9ab09505485deca7dc97e470f69c65b306c746c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2810', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e383ee249346b59d7b62b98562af50fbb21fb15c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2811', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d2cd588926549fbe11c09317f516a34ac567a93a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2811', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:560950dfd0fcae185d93aca4dc1d4808c1f9f998', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2812', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ef5c532f0ba49d3bf191a1d09597b9dbac1cefd9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2812', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:796b8a110d21d38aa168ce27ace917589ec7e0e7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2813', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1f17ce03de25279b9519ab54c86311fc2e24be92', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2813', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:646e2df330a55b6e7876a28b9310c6cf6b185468', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2814', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e24a4feee13ab099f170da230c43ab20ab327b15', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2814', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7153962a9fa10c73d1cb0a5d908f0e4f7bc047c4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2815', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ff67b536dfa5bc612a0a13f1a44412f74949e7de', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2815', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7318aa8cb7557dbe95685444bbb31eab4e50066c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2816', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ddaa210f8c3a04d57e034648cd1e452934a5a19b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2816', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a222776d2ff07249ee1d74daee993b5744f1d1ea', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2817', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a43d41e92994cd4dacea3f54910fbe883fb3dc05', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2817', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:22bda4aaca3a8377886a42f524514bdda1d8dce1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2818', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f643f7e05b47cb6b79757b5434aced6bb4b477fa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2818', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d67e472af89b407eea223e6a83fa9ae458e1ca20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2819', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3efb0700090fb5cb19cf9c4f37bd4a4f363d3aa6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2819', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ef9f4405cdf8cb01d52fdf67074614550ccc7b6a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3fd3a502f8ce9be0da800c5a0248e081f0c1b102', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cdf232435180e4c5d7c177262f4f7005287179b8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59639c44f7de2e7366fab056ad183bec0a0e86dc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8a0b52bcbd23b1c333c26c0b2f6733b499195363', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f171866a9fcf80dff2d9339d2498b6944e2c492f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aa6f9f8ec69f78319eb81cb30bfd2543c1a6c7cf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c7423f0726bcdd131b7da7b21fa4b92cc497c9b4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a6e4d5d0b759f67b2372b83b1b38ce5d8d218b84', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c15842c8452809ff712c6e617fe0430b7d25789', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d5c4b649660b27b0b9226d4330e495ae93153671', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52dd1d7603021aa802931da7b98aefbb8e5ce6cf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e281f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6c23339b511701a45ed0f08025ca65fcfd8ff9b5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2820', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7204b81490aea3d6cf1d3ed54bd0551c0740a63d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2820', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:11ee4b74830b6511646239cbea8f631f7965f7fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2821', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:33d5b857ef844990d86b70e6719fe3cf64581d53', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2821', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1d67e66e71e26ead1ab7c183e93db73073735931', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2822', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8341a2b99c74c5410f4ab8a9a789457196035ba', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2822', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:15ce8f1f452de4a80423c01d4d5caccf6b709d0f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2823', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b32b55c8d1d2f8c0cd86952fb7f1778c75dc91cf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2823', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1184cccc1771a9f2c06e49bf98e9453cfbdef2d1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2824', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a6467664dd6e09511a86677a5bb310c9b4bb8cef', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2824', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4eb2676f860dc385f543b91537645125c366f3fd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2825', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:907f7f26a115880ec7cc7e1fd93648d8b6b65e4a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2825', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6188bc0b2d998ca8b24c2cf63c18febecd38f9d4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2826', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bfdb5c539c72d3786bf2259b658531f1345d570a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2826', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3cd57f1ed09e6e51893a45100abe32a9bca2d7cb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2827', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1598c3833b7e343aaed9baaee9c51eaddf8e23bb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2827', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:72b9f7e787b4ef6fc65a23802a835a0a2b5c5a6e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2828', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b3b9116871c6892d5dde205cd64970069ff98254', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2828', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a5125d742071de74758103fb026e438d3cc5ea41', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2829', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f637487f80148f4d1bb86135c984422dde4ca61f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2829', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ccdfed362ae25a86feffde4fdc88305c5d815976', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d734506a9935e1dca22173552bf86ec682811f7a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1267b2ead2038ebe66f034326bcaebf9126f62ac', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c6c9225d642c1df8af2c738a038d049fa17a7fca', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:87a567b4b88326322919f366d614a99cef8a818b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:648b9d5eb34cd3888975520191ac24b51dc2770a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c7efa1e9136cfac514fd927b3748d110d0bc23c4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:09c8c13d1c571bb9f57a412e12b5d363c1ff10e5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:37e2a5b4646acb5d1f2bcac4d12eaa23d3298758', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a7cdde6c92159139b54b0fdb51caaf40b4ff38bb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0194f6f88738fd4b4e755a50ccd51a2621cc29db', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4e9e97417e875cd928c500bce1e1d1e7524c772c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e282f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f4f048b097c52068998ef5512b9c0c2163c32255', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2830', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c10b5e6a86628d64c0f821dd59f978d1eb3b6e65', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2830', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1df27e9bb9e136147933721e9668a8dd8817dd13', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2831', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0458aee151da66b95f05bc99e668c1536c6b7056', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2831', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2f56572ea06698adc9ad97bc7780c7cf4ecedeb9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2832', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8dcb729e77d4778ddea5cee9e87bd1d4615f5605', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2832', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5ae43e1a9f74f40f8017340d7dcb8c22ec13f0a6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2833', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:89f046840004893173f3e0a6787c50c7a79eba34', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2833', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:582f2269c68d61d3dd36fbd148a2e35c8a58f542', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2834', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f6295002ddaa27ba1208b7e0980cb9c8e53cb10d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2834', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7b3b98da721de7eb25a9cd28ffafec706e342705', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2835', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93e5ccdc5cab00dc7e8120399bccfe922acadf61', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2835', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:71a1f5ebf78bae19c26d8403ab21706cabc56896', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2836', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1177fde99bb98a280848bd32a0f165c9c07f7f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2836', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c7b870930e2ec937efdde4f9a1beb2badb585db0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2837', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3d3ca9f4f18572ad1194b80b5c949730477fccee', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2837', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:73f9cabfce7940408ad6e2646365327d066d392f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2838', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1dc644d4ff2e1e8d5700798367eab3c2f471771a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2838', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f0ea828e52a1c1723dca5a399edc7a1fc368e9e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2839', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e9e5b2b43fbc24a2944d509afb183dded01f713e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2839', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8f239c7029a3215d9b75efec3773ef87c98d71b7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:40d98fa6bd8335ffa10c5c7e810dcf0932b1c98b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bbf7cefb9ef95acae8a8b0776e6f20838331150b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:58c74ad9bdae72e953eea3e04d9ef6f57fcf5206', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e5c599fd25e33b6f003ee9a6fde9b64e93e19f88', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1575610c92cdf222615efe413eff8c8c0c935296', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9a2233a5ef4a568c1ff4ea978bcbfcd87923fd7b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:667fde2a6ba6f121d28017447c4b177f30ab5423', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:52225ceacf3fb2636f6f3e3411f160668094dc84', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68dc095911d98e4773897d51630729ae180e8d86', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:657edbacf58b38860cec7dab7eb5f2b77e2ab77f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a7deac3c218d5d6b657cc962cc6d49d0f3c5772', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e283f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:184c2b82a57c8d4adfa7b9a5906cdc0529f09662', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2840', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f2527ea8f1b2ee4708bb8dfc1080cc09462b100f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2840', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c168756586efc5412af189b4f16ae7daf45e4119', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2841', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:967741513195d7a5a165a72046dccd24eb58e4d7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2841', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:12dc3f077881edd99bc9dba5b0bfb9ec222b339c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2842', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:01acf4b0e253352d6e104a2614c65d2f89a890e5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2842', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bbf97851fa36facdb839de1115aa253bba239d97', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2843', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:16b424679b60b2ac0b3556e4b8a8ba75ee746a46', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2843', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6e33a152021679ed19cbebf7ba8d22848c6bd35f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2844', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1faa9e1ffa0db7ffa0e5f77f3b1f111f1a7a2fe1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2844', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a4187fa5065914e5be39acde7d1bcee32de0d0ee', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2845', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:068bf878f5b744442bcbb650fb2a651266d05926', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2845', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:724c54891c73097447713c4a43fb16badb31a288', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2846', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:26d96b64c3435f5546d8f339a79ce0447134df9e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2846', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7a9b68d3aaaf10e60a3b0822be44aa488fe9d555', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2847', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:56b4ea98cc5ca0463408557a051ad15da10ee421', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2847', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c903f1b515400c13c99257692a6a023f9b507811', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2848', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:53f8b779e1b44dbf54ef4f1627fe692f24b82173', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2848', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c6345b358e42f272c504d2fd66086e25efd3166d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2849', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34ce406579cf09ae40062b62173dea22ec85d43e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2849', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8a6477a47f49c241ff17d2e196734cad1f0c6a94', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34c70c68e862420ea94e177071614590fada963c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d41dfa6b4eb3151c4d21b1cf5dc7a33cb6daf235', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aacd8ca5cab0b15325227eddc16c3349988144c8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8bfc78b46ed4b76ce29f29619ec4159d4ad292e8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:985f2f548843b1a5297853c85793026c2a6c4a36', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:834555a0b50cfd6754c3fd0fc2157e7905bb5a9d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72de44ee48b64a56f7ea3f03af7462cdf91abd2e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:35f8a2340a6a0d6244177349ed8d7615b5acb6ce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c1ba6c171b212e4110dc6f1ce062f36a27c6952', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6881cfef567be65aa98c4b817c59d6c1af50c765', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6d8ac3b90aa9cfa5c37227054acd53d427033ffe', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e284f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a7107a003b03cb6f287163fac91bc9e74f9d3cae', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2850', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eb4e039c7f26e00ff04abcb9fa1e11c1f0e3acb4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2850', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:08cebc1d4c7706bb66d61224e40e40b1e584beb3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2851', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:991043fccaea4bdf0e7ea2b8076c9fb0506975d3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2851', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0eb82d774dc3d33c05ceec206c69ccfa94807f57', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2852', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0fd12ef94162e7c4919992def30152a66b113a7b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2852', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0b9780243aad9799610c5d0af4fe4b84e8fff613', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2853', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e0c30fa3172d0ea03c134b10ce12b136c5bf4e65', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2853', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b3327e6dfa2948b3acb432d1407f3d6ccf8c924b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2854', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d0ab2b12f3c3be9b5dc111ec9a5ab1b613d522db', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2854', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a981824e7aa6461bd1d0e2ab1386858df2166687', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2855', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:94d278f1200fd9d5f5f9de9d1a8f74bfd3970e22', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2855', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d21b847ed16b78f5aca0d5f1d90d71725ee95edd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2856', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2364873d71991121de1f679bf9a62128559646b5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2856', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:77cd16a799ac06dbda92662dbdc08f26925bdccf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2857', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a6e0c1d0bf032ea3b8c3410c6660faa2955c19e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740725911fb139cb87e2857', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e411fb139cb87e2235
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2775
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2776
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2777
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2778
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2779
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e277f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2780
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2781
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2782
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2783
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2784
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2785
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2786
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2787
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2788
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2789
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e278f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2790
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2791
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2792
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2793
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2794
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2795
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2796
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2797
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2798
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e2799
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e279f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27a9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27aa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ab
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ac
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ad
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ae
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27af
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27b9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ba
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27bb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27bc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27bd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27be
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27bf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27c9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ca
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27cc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27cd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27cf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27d9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27da
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27db
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27dc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27dd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27de
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27df
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27e9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ea
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27eb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ec
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ed
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ee
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27ef
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27f9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27fa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725811fb139cb87e27fb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e27fc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e27fd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e27fe
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e27ff
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2800
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2801
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2802
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2803
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2804
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2805
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2806
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2807
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2808
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2809
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e280f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2810
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2811
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2812
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2813
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2814
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2815
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2816
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2817
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2818
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2819
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e281f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2820
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2821
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2822
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2823
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2824
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2825
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2826
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2827
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2828
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2829
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e282f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2830
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2831
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2832
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2833
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2834
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2835
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2836
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2837
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2838
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2839
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e283f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2840
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2841
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2842
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2843
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2844
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2845
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2846
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2847
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2848
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2849
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e284f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2850
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2851
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2852
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2853
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2854
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2855
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2856
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2857
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725911fb139cb87e2858
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9f402a9189f61f7fd7ac8780adabe0d024825f5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f04f0f0ef9b1f18e6515d39da239efb786c773c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:507c2b2e13c82f3b0c1a342c96d10b7ac4c83119
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9138c02694fc4d9339933fe5836cfd92670bd41f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31babd5a7f2f7179621218690915acdcd2cfa4c0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64cd29f87b1a7c9cbca086085d2b7d6d83244905
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a32bfecdc7a8c2b1dd6d85458d6ef882387be67e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9f88117ba9d5c536c664c96b1fb4914295e557c9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85b84194a7c356e841998fac096bd76a7e93ff6f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9229a86db61801566c3b82932cf6d40ab1fa83a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64ac513dd8b5b474655a07bbfec23e942c3b9a9e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dd162b8338b5e3620cd53098cfc423f587697d1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2346045322a9475e72459dfe9e103579e79de7d1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64b0391b72ea2237be80d3ad9ae25121ac3953b1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:512ac7199df581d248b34093e173d0aa4f5c16ae
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:132efe39dcf6a9412fed77f8598fc33e5a9c80b2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6b6c1d03f986e923a67764a3e09168f2e90567e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e8f8c339f801936b75005d1e8a4581efe4e8189
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:496dc815864d8f8519b8a09923a0d0868f8ca0e8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dad03325564212346e0dc63948746c8c89ea7eab
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59fe0dfae1ae77903067a169833af96c45acaaf7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ad2a30880c457eaa1d7ba11153db5c21124845c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d89d102c15259161b4cbce808e683406597ff366
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de9df11e69543070edfa476ae08c64342d49bc06
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dda0f4cc331879a1758da5c1221e40bef26e7421
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c38996e2fcaeaa7b26bf996ea2295bf3fe39f627
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e51f129f60a945c2307b8a509cbd3131d29406fe
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e52beaf86bb203adf935be27b5c41df0cbcf92d7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:97970ea2f9d8e58cb46c0519dab90429bcf0213d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:671422fa1269acbd65d9e77c003ae8eb51b21116
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86d35b35c96a7c2d9ae9b5b4ad78ab295d24208e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64dc994b392d4e4c27f1a6055df048d3447f25ac
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0312f0f59baaa7d03742703bf834dd74d45c3301
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d880f8e7a4ed7ad6a34b9ffc44099704c02fb2b8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef426214daa74ef5f9ccba4269ea73bd6dc40f5b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6a246e567ca0337b3962d9fe25cbda36ca7f7d3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b247fec16cd537fd90976ad425459c1dc858292
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee748b2c8ae9822657b7281a64d6e3462b524faf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3bb035bdeea2abdb92991a3b214d276a99b6d79
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7591c3b1618fc610965d035cbe82165ccf548e8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54e9d8fb1c6248ae2158fb6f53d2666b3ce74158
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5bfa0558c0dcf0a28874d765b9f0c0fb19bb8724
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:429d89378f63bbf8ff7b85174ea96075bb6a77ed
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82b3f8debdb13730a135e6f876c6063a749713a6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb3f5b0eebf650e7f71574137ff699ffa4972051
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1e130e84af68c6c4d8bcbdda143ecae9237c1d0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16d93c8e6513dbb94750db84cc3f3863edf3bfee
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45902be3474ffda45a4da43b357c955063d344df
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6f60626c9fa202c31885c47d249282b48e8eb41e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:099eed215e37d7f86c03f25274893afe465b3029
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:476a7d6eb29be92349427f9d9f7d7db9018e6980
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:042b9f2adc6278869fcdabc4e5061ffa3af9a713
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d70e993f787129769c9418ae61e2772dd532e20
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7825a65d20afa3452615aaf254747296c5d673d5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9639a09a847faa8f1706cf942569f78497f45f57
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9a547c736b158edec41939898d6fbae94e8ec27
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:963e9191e9f5d4d3c062676ab72781db82fd2d3d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3feecafd1d33fec56f1d6149142b4b7282ace68d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9961ab527e743bec44dade7102dc30bca11c5abb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:765b0d6f4046220cfecac2e0c1fac6c630895bce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:701a69551279e0ae3dbe6b2217ac567107fb16f9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59efee663f88ada9d8a26159b52fcd89532c9be4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92bccc18fe14ae758bc0abd8b99e0bdc636e4b5b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a13e723f7884d9e7535462383d44ad34bc7286e4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:985718ca31de083c47ee9d41c60876287f881015
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30294de87e2942abb95482b5254deff300433404
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7703256eff8334141ce689e7639528a15180247a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:497868566cad8333a4f875c53c008021fd0e8201
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fec1f10a4ade78e7071fc2b54721af009d6929a9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66d5da59d70e72c2890e92d4758f4dc3704217aa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb65b5c3c87268d15e83f84aca9117882b57a4d8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6affff79677e1991b5aa772298a359d6aecb21df
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b3be04846d6234080b5dbd5a8b7a6333e10bc0b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06212b5d6cc90c5e206213666bdeca84c133f2ce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a573c2ae4edd9c1c9d58dbd5c55be9820bd83c2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18319ff87c69cef7e2058a981690ba62a4b1d144
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95e37eeb238b4838e6c11039be6776ef174fd028
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd45e9005834c5bfcbf2a54fa778a848885b51fa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56146bcc78e8185afce6bff3091198a3f63f7c85
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:035cbebc8e1c6cb57230348ba2fad167f0c41f4f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a61f5d458bd3a5afe2abb93ea8ac6d75ad6216f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a551ff0d6494dddb8119dffa09da1076f4f5cc1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88df9d32d8d1f433987fc4ab4610d59abd926d8f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45db212be4cb6a1bdf11976e00996c6f10e24e6f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9678a36e6a35e3ac9a92f62318ba989ed7864eab
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6a44a5d79df0f93f36a5710a6ec2ad86b45b814
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6aed1169cc8cdea588fafec8c47f54a2af4a5a26
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a117809ae6122ee90d1a3270082ee556ee80020
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e960091e2737515deb6692ab0cc5cee84926c9c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd4dc8859cc2e6cec8c895895393005d1388325c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:801a9834964c6925dab84c63af69e7848d9d41cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:25d5c409d6c210dab1e9ed5758e37f19a1bcc5a9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89a99a81cc5bd201c7efb8fb6c2ae6cdbda54118
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c634cd91c4b72075ad72fe61e30079b425c3bac8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75144bd5c53e1057e8e60b71f563ec89413dd3c2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8fc1bc4140ea659ca4139033227bc27f241f92c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad20100d44097b73484052ba297eea466c4aea28
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0bf466db2046d44793c2cb9b4cabe616d42c983d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ba3fbe9885896be6c35463d03dc5322349e5c72
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72adf0b912f23e4c0972073451ba5ed2486012a8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb2512ad736eac6c52010f5c110cdd3cecd2b261
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32c1844a0c16d87d6581bb47dc5695d0926eb761
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:14287ae684fb9ab20045d3c92d6cdc3443386d73
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19637c7ab3cd8a0651c21a80b9ecf3f12b37786d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cbb1f4d097a962ca1e1f3db9f2b670c63700f97
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9528344dabde02ea4bad0cc358147e1f41ab203
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d1a358aa80971fe747ab6057af716d58a14dcbb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c36add7ae6170fe2ddff9d7917ae7907d2fbc4e1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af702d47d1c157fdcbd5192a00e6526810a3a860
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2493088693a26e68b4421983db0873cc56bcdb34
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf2a8aa838c094c42981cb13c7ee2a4ce19a74d9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30b0f7b2698b665c87ba76bf9148e285795808b9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6c4d94bcfa7831c23a94379281ab96f7ebce563
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c26fddde8f54608a570324d424ce30569b96ce55
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f516f609d87d593f9995a1e6dc881d89f0c427c8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed0a5364d561b9b1ea419b50c0432874be9ffb56
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c326ece77a70bc1e8d6bdab69f9e1937e9992a2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc3ea8733a5bda38d883cbb819dbbcccb41aff00
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd764dd6565f0ee0c3dc8f7cff7da58d1877c390
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d4f44d1bfee54637949c87f1eab9417d3bef40b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb0e7df77c0231cf7b99a092469ef442e2c72719
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70840ad4d72d81b6aa1fdf86f6341a549e6b3902
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3bb809d8170d306bac97f3cb583097b8c3960fce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16edda1f6a9f481149339a07e4caa7ff2b0ca5b5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82d821ae89c6eb8b74f08f6a70ee6c7ffb7207cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a8a7e1be2f327ed62c98e270ecf8580983b1a31
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78d02fac20c4246cddca4922539e34017679f0eb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:91a6173c8272c67802441df26989524a48a83af5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3058400f69d3a0b8d6f483743cc888eed3ed98bf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:310f539cc6800ddae4177df7ec3ca6b995a76402
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2e65c05a3dbca4efdd8ac45b1afebb3f06ccc8a9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9e4a945dd27d17c7ba1d405757e117af835f1739
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23f5e1b1376e5cceb0f8beb6a88b65f2411b3e23
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bcfa8f2336dcfb1352293cab91ce38c8f5549ef8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ee9c9c87da55f78723691929d0dc29ca640c09f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1fc5dbfbb4aac20befac4adfc4016a70d01c46fb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72372d8fbe1b6911c21e337bfc26ab5eda6beb52
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b0d428cd2f2497cdf6f76f8a38f6414422237be
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ca3b6f6565e4ea6fb1760b4696a0294f1bd3690
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c30874393f962f4a129eb6092bc20c8f25158f39
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a57cf6bf755b7d3b3f738d7867e9a604ea58acce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b154ce3ff9aababa1aa703a7522509842b523e2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:427ce5c7375044d7d3a322f7ecf75500dda9daeb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed7c354e120988aec305610fbf7a2964e42b59f3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f034eab8c2244e6b7a38e23d5cb1c8dc8ad8f63
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2526d81fcc4a236376e6eed4674cd86cf6b1e886
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f68c2e3e30333575ad9c6b0a479fda88e2590db5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:083a2147d8338dc43bbf7b1fc1fb7348a032bf1e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a93cd018ecedbd455c06e9da166107aecc423891
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c1fa84748088ce1c93fd6372bba1c18beb3d40f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddfb3894142596d74a0dc85ec05e8a2a86900b81
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:87a0a3e1f4a9dfa3f7928514227db6e4cb9fd8b8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4cf672dccc6d32465b874fdf3f0839fec7056b77
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e68a467cf2a3821e9cb609b725938607af899da7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34717f79cc495dfc710a4de48aef63876002e524
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66acf438e114b7bf3f01bb5ec105c8e2a4b95dda
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5155eeaf5cfb9837bad33d5215b153dd107598c3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:205aca4d2f5b123f4e8674ce3084453aad6ffe9e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb33ddd1fd3033944bc46ef2286ac47fbe2569cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:14970c00d18eb599b1e364b52c55b2e50f3b27cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c615421fce468a055adcabe23170a4b2ddadea8c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f40f6eaa72cfb88efd0fba705175b5a1f3ae1c74
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:20fdc63c04c96ef721aed749a51ffe55547cf8d5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8b0e3b6c31010d49159d62dae71beebebd48808b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:792afe2741a6e9af9272c2ff3bfae1c05ec3791b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc227ce0034803efa1622179cf0d9f4a75e6c7c2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eacd90cdcd346bb0b7652b6571fefe72a601d824
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f8d06700723c86a49ccfdbf59d9426b89e2cf20
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c371dfd9a033399bb899ec1455edd197c0c7d35
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac946850785dc19f6c79e84560490f93fd31d1a6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff7240f699bf76edc870dd7e684c613a3c6e3339
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93e94961238a0ed2fb172810bfe0bb1a1c646d31
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62c6514d1237ef98d8f3036ba9edceffbb90e8ad
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:afca1d6f88db9e015cddd5bdd79ec19cc38c7218
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9af492f826820b5e886cda869953c36ecd6bcc36
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86589b0b3d8bfcf46e4de260804f092eb1d113d0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3899d9839ddfa5e5b99f06c9d6520fed60c01e42
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:000dc42989bc5a56ca7f5edc1fbef5ab8502fd74
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63d134cc361c7fb24404f5c38a4df0c778fbdaed
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8fcd4c69517f8b7a54df6ea31d4f8589415a63dc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3805d88d709a4361dba00207ad8a1d61d22d68ca
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a583d4624f50f5d38d6f1c1cfd1d7ac68d3cff3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c87124a92b19ec4cc0fd41fefe7b6cdd300c2ecc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12771aef3e524d43d003621fde3ef071241206fb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2144fd5a4d428863fb5a15536600f6e6cd5396b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb6a4f1e7eac2c81f578237cd84fab9132e8a499
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23f776f49d7708525fac983b9e719ee38af3673f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92c2b9a6c58767716ec67385f283eb8277e71f7e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0715a7196082d0d27ebb39e59c16952826015eaf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d38d87b5a69d445a22c4d90b39acedabfdebd8a9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:600d2592c0dc7bdb4005af43b8d30ff529040c77
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08a262b383908ba867525c44b7aa6e7c5964b578
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:605aea4b4204194ce3f38b3b2147aad707205514
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a893515088824cb3e8682501164ca9646492605
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:acda7115d188aa905c02e4885afd00b64c1e47cd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b129258acb0cf812fed9e7fa2eafc6f4ce43138c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:229352bbc2ace5a599ddb28efd7d558615723f3f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f88b6b1d857f7ee2e59aa23a0988d47c8290ae31
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef4e5d63578a15f0c363ecb07610c6834200069b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:509bfc2f6266b2baf65217543314a01e7d0cb98d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c271ffbb73ab7b477d6215c6c61f3cc7bd7bcf7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e2f240bedeb5af91d83ece6372724b1fd7893d4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:809037539d92741f8ba53e7f9007a112adb00447
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ba0ce8340c1d2876b07a1cc8de2e645e82e677a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a509e8437b80eea275136bedf154657981971533
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5ea92c7c3d9809b1303dff297a018ca379db19b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26f9ee8eed72db72b042b588bb0fa783c8dd60bb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48576c6ff7622173d3a9b02e359110775b564c92
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40f4e1c82de022e04fd7179042d28d9e1d82543a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c87976d7cccc522d31192768c3b1194eb0ea4df6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7eb1c3ca208d7d60384397ef6e894753c0fa77a2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba0f54e5c9f5b3fff46cfb4ea4b9574d3d482e41
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aefbacf7b1a8afda14b1f142f268b1cef7b69d9d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9117c98b79e8731e8d10b0ee69d55dc20cd549a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dba233498f3bc154b6d04ea14d7443c4d6ffb16
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1efb8e9153a60753374d0846fb6c4d7ac1c62e47
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b04ea3761da9dbf8f9e8a75b63e811bcb51b2c3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b6ee062643f39267db77229fabc0a51fbadb71d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aea23e1ff0cb81efddec5124326c2b8216dd4af9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e457253dccb623b18932858beaadd6382c2a40f3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:630bce4187c644ee57b41dde0878980a94c41461
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:caeb60d3b6f2fc60ffce704f1f15bd14027e5d05
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22a7846cd06618c49af9dec0d6d1f947e59f5848
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e8efa2d4422cb9e97f5618b1e840fb1bd4cc284
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fdc94925c406712ae36ef903e2a37eb27ebd4c74
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e08e65fb78a90e4bbb5f3f8493768290807d8780
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a91282f67da897176bdaa24118e4ec4d44ade40
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4377a90fb8271f6273421af4f409af7995202861
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd303527dff472fc8f172a5a62f40fa89ef69e4c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa0b14f1876cfd3972e971773261670a78270ac4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ebd16646e1eac8ab7d3921e34a0d659abd815d6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3e6c90bae2406f4450d7b083721a183a49590db9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:281967ef13fed8da86fafb5ed74c2095626fd15a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d37a1bc9c363a7e43d3ba341714f48976af98f41
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3c82d8ed6f4aca58d1b790499c327c868e0f2d0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0fac962090919eeffe63c70f61ed2398ec3238b9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca42a566bdbfc31a43f75f23df13d1b1cab7dc67
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3dcf30557c441253fac245c2f45c0dbcc340b3a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:273dd976890630d319f649d4a93842f16461907e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3540241c83e8191eac39f300b1be241b5432e0e2
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:185daf24f9e77fa1607ef3841638fe01ad68a4fa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af56a78cb8da5c5e5c41b7eb4c5b732aae81984e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5dc26426af0771a5e353a65e69ff4dab5dc9199
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cdf2c0544bfe4a567618ccebc6712daeb7029370
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0384697cc49bb3ec50f95f30d0cc14dc0df50675
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:656ffab18f62714d5549c5d2a0ebe8ea03f9a0ea
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8552a21a00e9381b766f0d97388f24f63d533bab
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:17782abafcb8fde2f9b14bf28dd8ce46ba57e6cd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31e2309faa21cfb56256792542ddbb1fb633cb44
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8347f04b3d5b5b1c8fc2942696cc7cd4f4c50319
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e96df341c77dfbb0056a22cf8eca39a623fed97a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a440ecbbdb1dc074cae6f24b6f23fb597792cfdb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c54f03f0e6dc713ad4121ae488a0a5eacbc5edc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05c4a51848023a02699ebc83638bff5b60e4d17f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e0f4178c06ae12b44e13fc30d5228dae71dacee
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19398f4bad4bad2dc04f02c5c9ebd403f9cc4a8b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ce94767d3a3af3b9612c9bfb4f78c17b244cf93
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a8bba550e55e183a0665ee8e1c680dbc3280c050
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8652a058c5b1547943d6662991fa6ae0c783879f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:451b107f1e8955280ab7edcda0f448920b839cb5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e4dc010758bde4c0b5aaa117b18956ff01cf635a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b7ae1912355c274d92f58eb060e6630b8c92a4a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6667a9613e7b1c3b77f2fe15536d15634778778e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:422f1c0bcf8998f27d4a8888dc0e748594a1ce90
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d6a1e813470ece1f847eb8544e3c570689781b9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e81df593f8badca53403395ae0968bdcb24a216d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34fc3908b6dc6aa894c31e45aaf4505e1a0b5c1e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb591177df1fd13ac55be3fceb0339afb1332021
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21d5d07197625fd84302c94151caed121c4c4c40
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4bd85c607561813311e772d7371fb35c49d3b27b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf9901eb377f3fbb0a8522717105c12ec7c647e6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63efb9400f5b2eeb75a4f76d040b8630fe528ff0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47e029b3ed4d17481abe245504159f39108cb8db
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:710b58e13904ac3c1fd964053424932cae053b51
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a8e29e261aa25700e3c434fe8566d32f827afc5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:498bc2cd01c69c1e1d464ce6da9f2ab76164b120
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11e001b866795ae4745b55cd51005d814d01cbc6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a142d9d60a371f0bd2e483fee300a6d6547c7bd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1f7d74135270558574fad66400cdb368dce1f8f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2442cddce2618a718c63d843383d208362791ed9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67163dc3104e25e453d4e649282b49fb1c2880de
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bcd5054bfc034dad84f5bc9c85c9ffd3835d9305
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb291647565ae853b64aeea775764d5e45022fc6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5044e0f630a4ddfe3fbd7b3e232420c7c41615f9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b707051e9f4b9768bce6900b09994932bce2216
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6c7212568a473359cd11f8c46aab8c4bd29d7af
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:569c56d3418698b648c8f26e39436bdb58f0fcbf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:824d2ca6caa2eb31d67e050febb6da6916b005a3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a2a05215d5c2e695bfac5e0a8fc821875ea8278e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e456c3320a28120387f71403a5d29d791458035c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99519091aace4dd07aa371bbf4b223849f1cf227
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1bb6a6473c7718893609252d0db9e2c0d6095c3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f00f910445c374f660cfbebe4af7f0500658ee6d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cadf2b84ad0768ad919ea059c8b9ec1edaa3297d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b92f2950d9f77fa482e5b7842c4485da6ef9d76e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9ab09505485deca7dc97e470f69c65b306c746c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e383ee249346b59d7b62b98562af50fbb21fb15c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2cd588926549fbe11c09317f516a34ac567a93a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:560950dfd0fcae185d93aca4dc1d4808c1f9f998
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef5c532f0ba49d3bf191a1d09597b9dbac1cefd9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:796b8a110d21d38aa168ce27ace917589ec7e0e7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f17ce03de25279b9519ab54c86311fc2e24be92
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:646e2df330a55b6e7876a28b9310c6cf6b185468
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e24a4feee13ab099f170da230c43ab20ab327b15
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7153962a9fa10c73d1cb0a5d908f0e4f7bc047c4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff67b536dfa5bc612a0a13f1a44412f74949e7de
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7318aa8cb7557dbe95685444bbb31eab4e50066c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddaa210f8c3a04d57e034648cd1e452934a5a19b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a222776d2ff07249ee1d74daee993b5744f1d1ea
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a43d41e92994cd4dacea3f54910fbe883fb3dc05
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22bda4aaca3a8377886a42f524514bdda1d8dce1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f643f7e05b47cb6b79757b5434aced6bb4b477fa
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d67e472af89b407eea223e6a83fa9ae458e1ca20
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3efb0700090fb5cb19cf9c4f37bd4a4f363d3aa6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef9f4405cdf8cb01d52fdf67074614550ccc7b6a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3fd3a502f8ce9be0da800c5a0248e081f0c1b102
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cdf232435180e4c5d7c177262f4f7005287179b8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59639c44f7de2e7366fab056ad183bec0a0e86dc
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a0b52bcbd23b1c333c26c0b2f6733b499195363
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f171866a9fcf80dff2d9339d2498b6944e2c492f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa6f9f8ec69f78319eb81cb30bfd2543c1a6c7cf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7423f0726bcdd131b7da7b21fa4b92cc497c9b4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6e4d5d0b759f67b2372b83b1b38ce5d8d218b84
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c15842c8452809ff712c6e617fe0430b7d25789
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d5c4b649660b27b0b9226d4330e495ae93153671
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52dd1d7603021aa802931da7b98aefbb8e5ce6cf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c23339b511701a45ed0f08025ca65fcfd8ff9b5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7204b81490aea3d6cf1d3ed54bd0551c0740a63d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11ee4b74830b6511646239cbea8f631f7965f7fe
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33d5b857ef844990d86b70e6719fe3cf64581d53
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d67e66e71e26ead1ab7c183e93db73073735931
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8341a2b99c74c5410f4ab8a9a789457196035ba
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:15ce8f1f452de4a80423c01d4d5caccf6b709d0f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b32b55c8d1d2f8c0cd86952fb7f1778c75dc91cf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1184cccc1771a9f2c06e49bf98e9453cfbdef2d1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6467664dd6e09511a86677a5bb310c9b4bb8cef
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4eb2676f860dc385f543b91537645125c366f3fd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:907f7f26a115880ec7cc7e1fd93648d8b6b65e4a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6188bc0b2d998ca8b24c2cf63c18febecd38f9d4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bfdb5c539c72d3786bf2259b658531f1345d570a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3cd57f1ed09e6e51893a45100abe32a9bca2d7cb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1598c3833b7e343aaed9baaee9c51eaddf8e23bb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72b9f7e787b4ef6fc65a23802a835a0a2b5c5a6e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3b9116871c6892d5dde205cd64970069ff98254
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5125d742071de74758103fb026e438d3cc5ea41
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f637487f80148f4d1bb86135c984422dde4ca61f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ccdfed362ae25a86feffde4fdc88305c5d815976
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d734506a9935e1dca22173552bf86ec682811f7a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1267b2ead2038ebe66f034326bcaebf9126f62ac
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6c9225d642c1df8af2c738a038d049fa17a7fca
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:87a567b4b88326322919f366d614a99cef8a818b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:648b9d5eb34cd3888975520191ac24b51dc2770a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7efa1e9136cfac514fd927b3748d110d0bc23c4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:09c8c13d1c571bb9f57a412e12b5d363c1ff10e5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:37e2a5b4646acb5d1f2bcac4d12eaa23d3298758
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7cdde6c92159139b54b0fdb51caaf40b4ff38bb
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0194f6f88738fd4b4e755a50ccd51a2621cc29db
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e9e97417e875cd928c500bce1e1d1e7524c772c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4f048b097c52068998ef5512b9c0c2163c32255
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c10b5e6a86628d64c0f821dd59f978d1eb3b6e65
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1df27e9bb9e136147933721e9668a8dd8817dd13
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0458aee151da66b95f05bc99e668c1536c6b7056
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f56572ea06698adc9ad97bc7780c7cf4ecedeb9
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8dcb729e77d4778ddea5cee9e87bd1d4615f5605
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ae43e1a9f74f40f8017340d7dcb8c22ec13f0a6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89f046840004893173f3e0a6787c50c7a79eba34
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:582f2269c68d61d3dd36fbd148a2e35c8a58f542
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6295002ddaa27ba1208b7e0980cb9c8e53cb10d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b3b98da721de7eb25a9cd28ffafec706e342705
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93e5ccdc5cab00dc7e8120399bccfe922acadf61
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71a1f5ebf78bae19c26d8403ab21706cabc56896
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1177fde99bb98a280848bd32a0f165c9c07f7f6
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7b870930e2ec937efdde4f9a1beb2badb585db0
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d3ca9f4f18572ad1194b80b5c949730477fccee
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73f9cabfce7940408ad6e2646365327d066d392f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1dc644d4ff2e1e8d5700798367eab3c2f471771a
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f0ea828e52a1c1723dca5a399edc7a1fc368e9e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e9e5b2b43fbc24a2944d509afb183dded01f713e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f239c7029a3215d9b75efec3773ef87c98d71b7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40d98fa6bd8335ffa10c5c7e810dcf0932b1c98b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bbf7cefb9ef95acae8a8b0776e6f20838331150b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58c74ad9bdae72e953eea3e04d9ef6f57fcf5206
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5c599fd25e33b6f003ee9a6fde9b64e93e19f88
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1575610c92cdf222615efe413eff8c8c0c935296
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a2233a5ef4a568c1ff4ea978bcbfcd87923fd7b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:667fde2a6ba6f121d28017447c4b177f30ab5423
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52225ceacf3fb2636f6f3e3411f160668094dc84
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68dc095911d98e4773897d51630729ae180e8d86
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:657edbacf58b38860cec7dab7eb5f2b77e2ab77f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a7deac3c218d5d6b657cc962cc6d49d0f3c5772
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:184c2b82a57c8d4adfa7b9a5906cdc0529f09662
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2527ea8f1b2ee4708bb8dfc1080cc09462b100f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c168756586efc5412af189b4f16ae7daf45e4119
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:967741513195d7a5a165a72046dccd24eb58e4d7
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12dc3f077881edd99bc9dba5b0bfb9ec222b339c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01acf4b0e253352d6e104a2614c65d2f89a890e5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bbf97851fa36facdb839de1115aa253bba239d97
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16b424679b60b2ac0b3556e4b8a8ba75ee746a46
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6e33a152021679ed19cbebf7ba8d22848c6bd35f
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1faa9e1ffa0db7ffa0e5f77f3b1f111f1a7a2fe1
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4187fa5065914e5be39acde7d1bcee32de0d0ee
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:068bf878f5b744442bcbb650fb2a651266d05926
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:724c54891c73097447713c4a43fb16badb31a288
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26d96b64c3435f5546d8f339a79ce0447134df9e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a9b68d3aaaf10e60a3b0822be44aa488fe9d555
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56b4ea98cc5ca0463408557a051ad15da10ee421
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c903f1b515400c13c99257692a6a023f9b507811
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53f8b779e1b44dbf54ef4f1627fe692f24b82173
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c6345b358e42f272c504d2fd66086e25efd3166d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34ce406579cf09ae40062b62173dea22ec85d43e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a6477a47f49c241ff17d2e196734cad1f0c6a94
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34c70c68e862420ea94e177071614590fada963c
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d41dfa6b4eb3151c4d21b1cf5dc7a33cb6daf235
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aacd8ca5cab0b15325227eddc16c3349988144c8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8bfc78b46ed4b76ce29f29619ec4159d4ad292e8
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:985f2f548843b1a5297853c85793026c2a6c4a36
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:834555a0b50cfd6754c3fd0fc2157e7905bb5a9d
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72de44ee48b64a56f7ea3f03af7462cdf91abd2e
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35f8a2340a6a0d6244177349ed8d7615b5acb6ce
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c1ba6c171b212e4110dc6f1ce062f36a27c6952
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6881cfef567be65aa98c4b817c59d6c1af50c765
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6d8ac3b90aa9cfa5c37227054acd53d427033ffe
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7107a003b03cb6f287163fac91bc9e74f9d3cae
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb4e039c7f26e00ff04abcb9fa1e11c1f0e3acb4
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08cebc1d4c7706bb66d61224e40e40b1e584beb3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:991043fccaea4bdf0e7ea2b8076c9fb0506975d3
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0eb82d774dc3d33c05ceec206c69ccfa94807f57
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0fd12ef94162e7c4919992def30152a66b113a7b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b9780243aad9799610c5d0af4fe4b84e8fff613
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e0c30fa3172d0ea03c134b10ce12b136c5bf4e65
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3327e6dfa2948b3acb432d1407f3d6ccf8c924b
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d0ab2b12f3c3be9b5dc111ec9a5ab1b613d522db
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a981824e7aa6461bd1d0e2ab1386858df2166687
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:94d278f1200fd9d5f5f9de9d1a8f74bfd3970e22
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d21b847ed16b78f5aca0d5f1d90d71725ee95edd
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2364873d71991121de1f679bf9a62128559646b5
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77cd16a799ac06dbda92662dbdc08f26925bdccf
11/22/2024 01:28:59 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a6e0c1d0bf032ea3b8c3410c6660faa2955c19e
11/22/2024 01:29:00 PM UTC [INFO] Received an event for node: 674070ca11fb139cb87e21cf
11/22/2024 01:29:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ca11fb139cb87e21cf
11/22/2024 01:29:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725d11fb139cb87e285e
11/22/2024 01:29:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740725d11fb139cb87e285f
11/22/2024 01:29:02 PM UTC [INFO] Received an event for node: 67406d3711fb139cb87dfb90
11/22/2024 01:29:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ca9cdab267f6f692e23efce86f56491c957ce260', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7eec5201ed431182bc41790c2e2277f11d44ae37', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9ae8d9582cec2bff64bbf85f70fe48ba1410d0a6', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca9cdab267f6f692e23efce86f56491c957ce260', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7eec5201ed431182bc41790c2e2277f11d44ae37', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9ae8d9582cec2bff64bbf85f70fe48ba1410d0a6', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb90
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca9cdab267f6f692e23efce86f56491c957ce260
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7eec5201ed431182bc41790c2e2277f11d44ae37
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9ae8d9582cec2bff64bbf85f70fe48ba1410d0a6
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca9cdab267f6f692e23efce86f56491c957ce260
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7eec5201ed431182bc41790c2e2277f11d44ae37
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9ae8d9582cec2bff64bbf85f70fe48ba1410d0a6
11/22/2024 01:29:04 PM UTC [INFO] Received an event for node: 674068e511fb139cb87df67f
11/22/2024 01:29:04 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:674068e511fb139cb87df67f
11/22/2024 01:29:05 PM UTC [INFO] Received an event for node: 674070da11fb139cb87e2207
11/22/2024 01:30:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bb4d9c9c0e48d5f0ade5ef59d061b2447647c99d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070da11fb139cb87e2207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6d43d7e71bea5931ec54c68b8dcdd138150d0095', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070da11fb139cb87e2207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:30:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:585553e70d9b18c9b4bf6a130b0c4e1e39130559', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fe60635e40414a44342baa4e91671bd88da8fc9e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:30:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:73ba871e3adbe55e0384e04ad1a2ebdb3909c2cc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c85b81c08bb001e8a17a752b36dc0a6581a15268', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:30:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee6bc6769065c9c6468da7b9e011b503c5c1bb20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6654d34c34edb1c4d1d9966b3d5822c931ce591c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070da11fb139cb87e2207
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e287d
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e287e
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e287f
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2880
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2881
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2882
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2883
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2884
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2885
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2886
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2887
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2888
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2889
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288a
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288b
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288c
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288d
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288e
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e288f
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2890
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2891
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2892
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2893
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2894
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2895
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2896
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2897
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2898
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e2899
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289a
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289b
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289c
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289d
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289e
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e289f
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28a9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28aa
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ab
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ac
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ad
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ae
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28af
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28b9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ba
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28bb
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28bc
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28bd
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28be
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28bf
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ca
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28cb
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28cc
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28cd
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ce
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28cf
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28d9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28da
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28db
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28dc
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28dd
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28de
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28df
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28e9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ea
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28eb
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ec
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ed
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ee
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28ef
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f0
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f1
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f2
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f3
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f4
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f5
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f6
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f7
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f8
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28f9
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28fa
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28fb
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28fc
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28fd
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb4d9c9c0e48d5f0ade5ef59d061b2447647c99d
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6d43d7e71bea5931ec54c68b8dcdd138150d0095
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:585553e70d9b18c9b4bf6a130b0c4e1e39130559
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe60635e40414a44342baa4e91671bd88da8fc9e
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73ba871e3adbe55e0384e04ad1a2ebdb3909c2cc
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c85b81c08bb001e8a17a752b36dc0a6581a15268
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee6bc6769065c9c6468da7b9e011b503c5c1bb20
11/22/2024 01:30:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6654d34c34edb1c4d1d9966b3d5822c931ce591c
11/22/2024 01:30:02 PM UTC [INFO] Received an event for node: 674070e111fb139cb87e2229
11/22/2024 01:31:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a00da1a0b129d8b5cd9c9d596b013daff30b7c86', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070e111fb139cb87e2229', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b500f7167e7a9ba97964742c01026ebb19183cee', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070e111fb139cb87e2229', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9b907755e799b4950863708db32106ea984f2e9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a28fbc2084b3d54ac405bd0be77059325944e8d8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c69083f2d39dd914b119fe369a3180553ecd0ae0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5832c52ad8725711a08a04a17544688b66cd0ea7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:919eba4691d44bea792f390aff1f761dde51945b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8200eb4ea598210daa3e4d337db363b67d814df', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:45c47c4f4e2656560193f267cd7511150e8b3190', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:976c1d68e125d512d671326a7703047f8ceed72b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e290f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3f8e91627b898516fb2557e4179596f2983f10cc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2910', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2e4c2e2f7376e9196d141a596943368ad7fa3861', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2910', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:267fc513b5dea01d2988c9b91f31d9c4ac22ea76', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2911', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:702edccd31665086cfd1591b16ee8631577fa203', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2911', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c0bf02b66c038d318f69f8e21d9a0965eea365e4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2912', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ec4ba8b780d23c8318b75afec1f6cb6eae259f4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2912', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3ebbd22012829e78cd56fa9c251d703a0c5d383', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2913', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:83eb260eb87f45322e0bb3ba5ce6d29ac7110784', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2913', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:73e5ce9970fefc95190d26a5fc49970922c6adb7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2914', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ef2c661b76c7d20c3e33f962d49c1eccadb67b37', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2914', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a45d5ed69c9a141a726891e6fe406476dc5fb1d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2915', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3021dda9b9714a0e3b42f57274f3cc04c366264e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2915', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3ccbe1f0c0817ee8dd991cd66159851e21947601', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2916', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cacf0a6a9223e4c315761b725c405e5a48de14b2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2916', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:75065883e0e0eaf3821c571e5cc521844b3db071', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2917', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b358d9ff9c9704baf66ca8221dd50904bff88440', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2917', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:51b42c89e742331a9242f3bea996a376838d6878', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2918', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:acc33ee02f03174d70870b1339ce3a44858192df', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2918', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c0d3dc04ec924768de3b019cb8a695059c114db6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2919', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63906ee7aa22fcd5fa5d22a9c92e397110473efb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2919', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:31:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aa720acdf1f5594918f65451559276e99232da36', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8173e62c1f6fe51e72432705aa9e8a467f8ebbfc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4cfdc43061aae78aea5c6df2a163bb70d3d454d1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a64d2ec7b591253206745c54ef9e2d247768f052', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:db0a5d30e12214f0e1db6a5aad093c028ef4aa3a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:07b61c08ed2e806c293a3391fbdf23fb36f6006b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0e223d6dbeac8ad5b97a63c312d4417bcbf327f0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7bc2f7c698e94ea80101815af3bc8a8c8141a26', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c8ca99bcff205d97524ab01a1226d5d19daf6576', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8699bd585d2531faaabbd55367d2bae67da29c06', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e5cb8cd8ab25b1d02324ab42712e8186f33de545', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:46f2703ca8b04cd2c346f6035c663b2361407a40', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e291f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:515902f408fc037b646e6da5e52209ede0f3979c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2920', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7b8afac584b8af03948aa559edad5393dfc1d750', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2920', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a79ea643ce3037c362b7d3a0d434c4c85ceec231', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2921', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8c726e9d683c953dfc47b81a252990d495dd895e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2921', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:41b3d367b304a3d1d7c848d9635c772b277e39a1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2922', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0ce106eea03b1860682c48d73fa2fa04728d88b8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2922', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:34ffb847b5c805428c1c3d670bbdf0c5a0764f0a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2923', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ed03260d22fc929f00d0e3ef3ea20597207008b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2923', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ccb290616ba78340fa4e9f959137e51652b2db85', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2924', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a7662d2e9884b4cf9b18b273242ee1a83cf9ba10', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2924', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:66e3f95fd65c120889864171ab53064f785da2e2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2925', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:60c7a8ef80e6e1d06b56c3c3b126c3aa715e111e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2925', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0334e58af957ff32bd9ed8549d3b6d03e5f1bd5c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2926', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abef4a50c793477dd5549a4591795290cc3e992f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2926', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e2a31d6265e51e62d5ffe54a87bc520191f45499', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2927', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:335fde32a5ec61bed85279cb36acfad67f48e4f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2927', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f775b5fe3ee3b333d0b81e316fb743fbbf3c63e5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2928', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fee8d260ecf9c05f40eb23934dfe96554dcd9bd6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2928', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:18fe239857804f0d243b7a56ed6a444bbe538d35', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2929', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:afb67fe445e7e96c14e9de8c3b91a5785448ff0a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2929', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a59806c6f17d758f4bf8a655b16d5ab4d20d7c48', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1ec4fbf1fa13b36d4e7bcb9e5feb46c01d3f731f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:62effc5ae7d66c8c46419d1a269285b49260d9d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9ce70a8219fda9a4e0fea8be2c1a88eb8502cfe0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:18dcdc8613735fa540c497871c88260eddf31ac6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de346a6f9875d7e4754673875c3602e454fdd981', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:509c24ba0482b01d1876742cbee81c377c3e8a5a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c15bc21f6371fe3b9cddbb47a6d1d7d534004343', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cf9e0038794a5cf73a46d0a5303771b7aaeed4a5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:313f3991a35914991cc0bf1b726835ac4844d0c4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a978f661caae4222d565ab771125360e70c11e12', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10761dde14d5da41cc3ea69919fd670590ac8d8b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e292f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f0a7dac946e44c39696afdf4915dded4bf121afd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2930', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e144c3965e2de86f254e80a1ea0b9277d3a627f1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2930', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:38da70f951b17f34857093d77dc043ca3ba7a23e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2931', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:17af10421a82f47f7b57a9e04e3c039832156c28', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2931', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1a5eb7b36c6a3f089778ecbc2e997adba744446b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2932', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf578c709003fb8cfe2adca32a4d9d19c542077e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2932', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d6147f63230e380a9eacbab500b20283c79a23c0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2933', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a574320d474d7768ec479826eb718cd75f66e8d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2933', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e416f408fabc74ce6cc56ce05fc097c8bcbdf765', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2934', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c556e7acadcef7b88c47ea75eec65bcf3cb6860', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2934', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c07df5b9b94adaea0725f93184bf77a80f5229cc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2935', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:65ee66df945b2c9fb13c23fed8a8b757d775a15b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2935', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8c3ee36130d333791732803d07e974fc5d0866e0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2936', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c761644ff51e9c9aed838e61d8ab918e485a341c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2936', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8afa9204bfc43a3ae01484705b28825acc177b30', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2937', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9c10776ab2c90edc5c8d16c767e244c92f7305d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2937', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d1bce74711174a19e2bc7c0ffff5a3fa88dbed85', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2938', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10c681d47ce06fd637d2491c64f983a232706dd1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2938', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5b7dc5d3be441b9e5ed317bd8d4472697ad3e784', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2939', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bbe65d8643f7071ecd54c1f794f37b447846595c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2939', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:38550d0a153e1140ec2e3e01f9b3dbaad8d9617b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:312427d0476b4439656a62fe5261ea73321994b9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:35739032232946d2ac142ef151454fd602972f1f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dce4b0a586346e8de0bf3544ca0290113e5899f0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54861cd9d1e9d603a9aa8d835bf7d5e65f1df340', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b348912d4c828556058d8dc6a5072ccb65b97412', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f599ccf3faaefedf8c2fcb1774f01a5b91b8d52c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd46e4e2c3125736528b6d05a993d519eb658e08', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3d092b0a4980bc37537cc8203b8a5c9665eee74', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b064b987bdc4d0bf23876b896c4b4644ae9b3b93', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5f5a925b57510982131f63c6d16223a619c829cf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d0f849612160aaacb9f0c15e36a8989a5c9d01c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e293f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:548441ed93c103fad4fccdaebe5c7a627149e0d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2940', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:985679116371039d79158cf273e9d4283a9f1466', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2940', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8f3796a2ac424c522d4ebfce4d908ab4c1091878', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2941', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b02c6765d3a306bef38bb80ecfa17e79cd827cb9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2941', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:636047ef6225d659b8c2ca93d465f03c93e98845', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2942', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:457ff60026cd564dcadbd712fd10edd54123150d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2942', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b7587eadee603633dd1616eac1d4b82f2e79de0c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2943', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee2ed7e61d97f7c1805e25ca01d74056573e847f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2943', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0088bd50b58f749048bae364fb0dc1872e6c337f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2944', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:743257d16ba8fe4dde2c0e05416d1c4a96c7438e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2944', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4eec7b54bb15429512c74d37f9dbe0e0f174287e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2945', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:63fe4a01b47158a95b0f87dea9ef734799accd49', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2945', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:414efb57ed837cbd49f9d8daa645b3d8e33b05a8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2946', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:73dfa67eb76b39f5f915067afd0fd1c0a07ecf22', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2946', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cccbd61d953b5e0c470ebb55641ce2338810941a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2947', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:edab993b31faf0657a2825cf89a52d0b46244e9c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2947', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:800bc34e24e5a7c1331b5f58eb0eb49a2619f07f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2948', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9117f966590518bafce2ae329bd8e314b7793855', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2948', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9c91940e92d6341d6e5c3f1c27e0246ace561ad', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2949', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a13290d923d867b47b30879ec0de2d64aa69e7f5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2949', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c4ae8aa58334775e435c22ee01200c424a8065a7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4b69e6f8da6dcdef44fcfad3a89805714da9a880', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a258caf0bc54107648124656ef17999fb3ce484a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:13e22667912c06c65f78823dc32c21a2913973f7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:261c686da311482fe4d1a7c48e9b47fc66a4844b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e7ac97573ce515fa1fc1b52e7d976f0c9166382b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9d0aab776c6fab1df04eea7631848e22f2145e5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f28fe2f3bff49affbdad9b8983fe3edb16a72bf1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c3a7a0ed84326541b4d81e264d6fb6dde430bb26', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e0355d3a1716eb12c16b19de13e8771c549b903', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c47d8989f18db1b75803f9f6a9cd72cfb3de59e3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca45610b943660ebe954a810e979d372f2855ef1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e294f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e7f39e0a6c578dcd39383ae01b10cd2c308250b6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2950', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ccc48f98a50fca6150317adcb3e5c1dcfa0a0edb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2950', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c5f78bc7d3884b88883a42dcb8df9c5de28ba1e5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2951', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3035b131ea4c5115191d02ab441b48006963bfbc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2951', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e7f7a24424704132510552b8f8b453977e8a11e5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2952', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f160c805f4be07aed35d252e89a8e1ec2683e0a5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2952', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:88fbb6de642d66e01cee3935fb4f893c5df14bb0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2953', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc669c2cbc44e0157feea9419c1a9c6c926b00de', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2953', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:83bbdc9f41db058fafeced62e55cfb4ebbe22952', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2954', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:858cbe52f55dddfedd0b924a613f78f522d6df52', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2954', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9144da9fd25a310644ef45dadd778d7ab116a4ba', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2955', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dc8bb265b695d62ca2344740459ebc087a1e339b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2955', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3c2452cc0d06db92bcf15bbbb3c34cd68b0eda2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2956', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e69d248c1d750a23132ef7e3e2ae309fa9bce170', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2956', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2b87d5716fc76b2078286f97812571621cac2ad1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2957', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c2b84e4e17ae190d1ea76e02d2d97e0891e426dc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2957', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b570f255ff4dd84cff76201723c23f4d2381fafe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2958', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ea13197ab80b9afc3978f2274563577adee49a6e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2958', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0c5584176c37635fdb706a87c7579c630e2c17c1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2959', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f5b31f6c02ac383c6d372387f3164ed5e95b99e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2959', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:613e29ad8f8c55ea3674ba07176e765143e7f0a9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:84cef729843735220eec8a7983ff040845c27dc9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:85186da745c2abeea13e3fe26e70352d3856ba4e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d82f8fabe7c3c5f434fe3d780265c1d82d5ae82', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1871e26243f6ccb94ba2135a45e9c52a170e2351', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ff952c932105a9a9b614cbf272bee8ace12d14b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b11357dfc047ebe8ad045484f5016da767dfb005', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4fd1a8cee95976f1243d5f6f6e819b575ffd3699', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:186dd1e10ad14c20f444f8f7baa53950e2bead35', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c7d6604e838d9214f745bcd6eea89f50daf157e6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e8bf44d16ff7546b41535df0f587d818e7cfb700', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d43e65c1a2ef4daf29b50f31a8413e540aeebf72', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e295f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5481d9e898f57bb0a8ff638c9473c685a5dcf060', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2960', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f092f05a535669f419aa5824f099e4dd369f079', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2960', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f0a2088243a4de980ddc00fc7f36f54f4a6280c9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2961', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93bd4a29d56892983f276226f0203a2f7ce03ee0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2961', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ab02cd47a816f9cb79b3a4da8eccd345d3b46835', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2962', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:41290c9ebfd7e705eef748cda516e2f8f770a64a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2962', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ea943c56df5cdcbcb8c2dca2dba77345f35e2f51', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2963', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:097c848a3ea24bf2466efe60567aea7093d0fd9d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2963', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4d7a6a5ecb89516f6a74c6b582ea7dca0af56198', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2964', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34f5e9ed1035ed62c1495c2a89be2fe17e21a640', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2964', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5cfdadd8239042f45e33e663c75383e6902a767d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2965', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:065ab9151524d748333fdaec59d275afa3bfda21', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2965', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4314b1da291988abd976a97035739025e235f057', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2966', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e63ae15449a4ebec1d7d681896056747f905f5c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2966', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:623f507e38c97e53dac9347436ac3fe017472948', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2967', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f0ce78c37019649981cc07892819be202a20b363', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2967', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6cbd58411eacc952ce626b8546c1634923b75d6d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2968', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:faf092aba43edd485992e2f5a3e15187b1b31718', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2968', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d2523c292f2de7e8ff966cb89c3c00c3ae381d70', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2969', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf3331211d5315a0b67b7d7777b901643df1ad87', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2969', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:44dcf63c0593b70a32cbea96d0143e2ea016fade', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d2889eff88319473c9213c8224720cf1b4b5f8d6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:857ebf6e94d9792f04850421065c9983d9c48ebc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a611570a493991c84f684c685fa16359b485a9d5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:42e43833c05387f49ea7b6c818d85c398a83dbd0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:35f0f383d4a67b6f329a1f3d5fb22f92e2aff2dd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4d9869341a403b57f22348d8f2531cc578078d20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7c0805dcd624dfb0c067a0a5fd62baa060960c8b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f94ec75602b7ddf6aa1398a369fe3c6222ae7a76', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c41f4690552780e052ea271e790a70659ba97755', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c759e8c6b6f8e91a006094c6a42fcea205e230f3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aa13ff18f4205f336e5526af24903c9f3155f1f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e296f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:be111eb2941f6d2c3ff8b3fb6163eb5309fdebb4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2970', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:912f5eeb4da1cfde2ceb4e75e80e4ab42f65ec09', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2970', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:17e312b3da9a9b63d5a92926bbe96937182cfdae', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2971', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bcf421908401890a5b7be35e79dd87616735b6ab', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2971', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:28099f40ab2f36394c636f4cb8f38591a315b526', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2972', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e761699f8435f793929fd972a85d637c3be45e98', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2972', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6f873fbc0efb85fc20458f72d64dd314c57184d2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2973', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1800db095e7d655ff477b105759ff58a13927d65', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2973', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c7c16ab886c260756bfee976baf5e02c8f28cdbe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2974', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab8aa321b79b8fc4ac4312cd665e10a751febcb9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2974', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e1dfbe1d759298d5b86fb36f452e10df65041043', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2975', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8a6c2208d5663fddc37e765c4880c5a6eee5a7b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2975', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:847a8d1f45accaae6c015725089772c897996dec', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2976', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5932f0ba359ccfcba5c892436f939ee969329907', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2976', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:397ceba165621c4ebb8e8016b04f68f474722dc5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2977', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc14eea470b2d7efccd797b3bc5f68b7af3d9c14', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2977', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c133fe93bd6ebdc69e4edd8d69f98011a7fa03f0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2978', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b3bb958ff4e11c3eb4e2a8ca0ceb5388ab1fd9ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2978', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bc50295b98b6b1fae89f1ed54b1b0d06bb63da42', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2979', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b52a4cec1296aa2cc84f4b41233c1c371dd5b62', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2979', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0bc6857a5a7e02e28d0f542bb096a247273b9ec0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:988b2f7e7bcc21b70682fc0d58706384ae58892b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f97087bae3b41adf743597ae9b2b47102cb1486a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a748b97ba23137a5ed966b031ec4ebf5bfe414c2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:21a2832a5b3a8901f310a7a0e81eb35751d0c189', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c1a29b9da127722f605c75c035131af2f7e3566', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e29892a82e4fbab223d58d0a254b566d3c3250ad', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c87850654f8f5a5c49b182157331ed62f71e8443', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3258de4e3b3ba80272052257e2f0b60d83cd2da', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:44264d7c075c74f7857d56926d2e51a8c5e38a05', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f7254b9ded248fb0b4bbee7feb297630591173e1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31c50db79d9a90bf6163605b404369a7e1d57706', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e297f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4ed2cf7d407695b567679ac87710a7703c9e744a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2980', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd16d92240f1015e8f626a06f50594f54a9330d7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2980', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4d77fb205c206d2576343aa7feec149f6c136d9a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2981', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0bbb521699d7e55cedbf8d81e8d25d66d3a20a64', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2981', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee5b95903f196293adc7beeb2dce196b6f7f0487', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2982', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e3335d6e283e9a391ec0142c1b7075f477f79727', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2982', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:33285b866e522d0164bd0133f5f6bf7853e4735f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2983', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d237287205f97c129df8a315eb9d5a7bdb05e6ae', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2983', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f08aea0047fb81e3df486ca3fce7ccab036bf1dc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2984', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:febb7ba9870fbb6cb56d0ac4eec3bdad8650f0ce', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2984', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0bd69efa625b329aff890aaeae6c86d6b3f97fdc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2985', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3bf130719d5a274180e449c0a9cd5967c88c09b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2985', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:85c7931c2830cc40be474fbeaccdd7aae5a43073', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2986', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cfe19d27445826d3be8c005b2af93055972240f3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2986', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1cbae018485b7655c2c63c6ee51d486167304336', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2987', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5f2233521a2a9ae07913b447081fb1dbbff9594', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2987', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:452d52d7037e6e731a3facafca614304e87a6a65', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2988', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:04a4e25ea61fc89cdd5e4b3e253d779e0da4bef0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2988', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e4c218dfd60c623f9c1e641e9c74709625639b5e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2989', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c39a2b3f43a13b0c1b635a1098bab8346886e1b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2989', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1f36720e0ceac270572b2c141ccfaed74264e595', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:927260b4033eaac075a535cacfe72f73282e5de6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:13ca87f9cb1d33cc90aee95620f02a39841844c7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:62624f8f848e2e4607178489b97cfe63f41f7388', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:62e2d004f305ac8d355c5dcc3e018ffd34aafabd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2733ad1ca601f9e146de08ca140e5aae683e24f1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b3879b68bc1941318d172cec78ca4c5fd6c2ab73', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:254066a32172c7d469d802b8958c39b5a41a428f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d6bd1ab7c555a8675579712fc11c4aeb02580be5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d076a1cbaa6bfde857ce59fb034c8300292782d8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1b8c727223d440b86c0917cc13e3600484f98d16', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de0e935cc16392987d45b977e8624410825bdd3c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e298f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bfb8e0508764db0018d501c5a79e3cb0b19793ef', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2990', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a05d6aea86cd33b5a86f7584b2f3d52cc3fab1a5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2990', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7999ee5e114696c92f2726d38224dff73608a193', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2991', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:96c1d40f59e8df0e537d0154ac7e8c9f847899d1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2991', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:01f5979d93a6a83a802a4ccb3756cb66a5aa15e8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2992', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f21070a645942201be9e8c7f851e969eab41c4d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2992', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6316a9e90408badba042e5bbab9deda6e952003d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2993', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4167ee551078ddc7c6ff64af0de91422715e8e4f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2993', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:286261e35fe0b5a1d38c2fd5bd7635be8555915c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2994', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:11231e3cfd0f539e29dbf4a9f8386065a2b7fa86', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2994', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:729524e3c2c679bd22cd80cf50cba4ec646d575b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2995', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:daf7b8c57f05209190bc0468ab125f7687ef71a7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2995', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b83703599b4a6438be05ed53e550330799421466', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2996', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4f1f659b9e972ec17f7411a94896d753f360d558', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2996', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3f72ead4228d5ee6d17bf90de643d936e1b0b0b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2997', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8de587ad4d28e9d888abe42b91dec7351a8e26f7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2997', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7fa7bb684d63c646e679b518b7f3a6034ee55cde', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2998', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:51ce66405a8c815f1e232a77dfeea952cda28589', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2998', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e05319eda519374f3d649d443a48ef542b38ddd3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2999', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1f0fbdbf1209301151186774093aa0cf26353e4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e2999', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:da031111ac9eef1c72c3b1f46cfe95d6a38507fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d8a42493dc15d1d8d78ee0227bb9be2bb20122e8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4ef247c2db83b2a8f606ed9f0db00ab492d6b8be', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b09b6c7bab50480f50c0a248ce74c8de7f7e89db', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ff63de6b885cd34c4f799b8e109024cbf688fdb7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ceece0170c0432241f01a17873f28d9ca986f6a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2c3d023e85a386d9b9f158d0e59e9f7761e14e98', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d7bca304cdc4bd883cb4d17883aab42da5f320e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:13b4a4a66e61c44adb918bbb5c5b3812195d8694', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:07ddb0a9b52533f5941b3970135ca9705198bfdf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fc184d40d7f14b064fcb352eca71c3f6661c0471', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fdf0da340b04ef441ce4cde0a6226d33f1a09b82', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e299f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee1ef79fceb8ffa577e35773c141262eee9295d3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:967c48eb9120432fda4d1ad55ab1a8b528267182', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:07d0669db847b793f154751d813749c39b76be9b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:130673da3ecb636f554765329bed4ba9b0440f28', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f431b9d04b09b51bb0ae4cf02ea806234a3bcfa5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:447a3e09175ba9df54d77d667cd5ff464f5a7212', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b57c96ac52a0064580548cb9a24623faf2de849e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac31043a2a0da6558b26bbfae0130a7d53c6752b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1b8c3ce582895376f025fcfee1a52fe77dfe0566', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1e521a068fdbf633ff2d776a8e7687d253a7fe61', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ff579067d056b84bd586a876420902e8a394686d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:45e814428f15093510c3ae264743faf94b19169b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:824fc489e14c41f8b2f7a04187fc6bbd2b07e89b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bcc99ff9d1575761e42538836160493eaf48c655', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:820b872e81dc0a0580b8ff0b6d15082fc5c89dc4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9873feedd2d1d126a5e4eab4106403c3c92f4619', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:99946b0d6caae1b807eda961c80ab8196895cd7d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abc131e607da3d8f28d1fded9bc7161c4c478879', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5fa80952eb84e61269b6c14df3e5aed456239b8c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0775de37ea351250bbf53dadb707328aff3751f1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29a9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2bf2f15214f8ff983766eb4537f41ad66d009728', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3113c7eaad9016e021f47ce2edbb41b379de0607', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29aa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2dbae44cec69c00d2188bc275ac07c4113a4b67a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2fe19f218a469a3f021a5538548d08f8c14daf75', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ab', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:11aadfe31aa6a3a6b3e75ad5c295957b9635f8ce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d525220c0e7961a724b150b10af96afeef53cb7b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0f51308015ae9f8cfb52ddb0d47a759531fc00dd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b5fb3dddc88f92076907e0c09db1d0cf7e0e0986', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ad', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c9bc0f66d01d141f645e49aa2897695b9eb423eb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e358de1a89ae181e3a70354d0ffc675fc118b3ce', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c73beb6320deecd0cdce853e2be04526cb5351e5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:85bfe97ed0ae6cfdcf4b748d5cca5b8549deafdd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c5be9c7cea5863c8f45432834cd829cf586f17cc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fc355e29315f775d96f677105e4807e3af805808', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f5e0bd5afc323263e4c7f88d33be38e97a73377d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4dbb691a85b8564b5b0642cd28bc47e9ae167f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b860da3a646156d9b0bd80e7e5cac74324341179', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2b15cf20b620be781e3bbd4d0244ed87ef3f601f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6c9fc80fabe9a9200d6f2e78bc474483224d367f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6fb0b9924dcd44e9125b3e90dece9ae8c5d8f48d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:229f5512180bdc291a7597aea5927280c07a373b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:003c635265224d96e69ce315b5cc648921b3053d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9ff14b83e9f814931a927dd4f9f6d4560a125fc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:caff893bd76b049e61eb09acb315edd99ac6afe6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f7827aa0ac5148bc3a1b5cffe3248c603a565e71', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7af216212955a31b6fd96834d16bd2c325001a1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0112fae4ffc3d69c1752151f50ba52fa043c7223', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:372bedba5e781fd753372af32f879a20ca5cadc1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0dad58ab59171f285c32ed2a4a8ec56d58acda31', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f53dce476ec7f9b9dfec61242fc193f198d2a4ea', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e5e31dc6d67154d17599345367fb7e0f71a4269f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cde70c92d5ca06ed6a469eef7fcaa80972589e49', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29b9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:137bc1b58de66984ecdfdad9ae870b0081cc1746', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:04b7d240884702dd10219ba9d4bf639441da6ec9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a6034bd7749234921c15181d6b52db551e62bba2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:04756119ab6eba850d67fae612d6864c25f70d25', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:135807de3db99568c5554ff43cea350c6a7e5953', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:67663c3ae66209e0496b9c49cbbd89b666ed5be2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:670b3934bcb4a6bc446b8c52e6e8eb53455a3ec9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:32ad74422f34c39518bd3d7ba8767f0133e21b0b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f59166a03f55f71289f7812b3d2a78b8fe7589c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c90b260f6f76ab8cfd97b99ebab9dda4351a968', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29be', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:44ffc3a08d84eb2cbfb3e6930c3fc2d96bd87a37', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0fa72b1d15e1048eeda27c546dcf356a934b5fd4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29bf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d76872cbb4c2c8692442eca57c68fd76fcc9e63f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3025be78243fd0783bd83043e3d02c386ba0439b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:69e68b4b79a330bbc3fb818de0cfbadf8a80cb99', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a14981e05ad8f651cf6bf5e779b975dde521bd9a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:32285ebb6d974ebb41589c623e8a6fe72fee2b3d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bfbf988415ec731468e817d17f5962ab96925426', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:598defd387ef061b5048c0695922b21953654b39', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df693879b11d0ac63fceb9d3836da8c7a82b7006', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:57019acefb811effed126b407c00b776bfe98927', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dbfb51853ddf191e9c8e17377749e3ccff19f3cc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f438297ec23f7045f4b3a8be789261785e9270e3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:40660df7398046b1b96d56600d889fe95aa2c432', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ed37e65c5b81086540019c360d253b5a483c9cd3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5cb7a2d7cd3f38fd95635f3cee6b63ecd56c5dd3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:89af07659d70562d455d16281cee9afe08977edb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f6a11d81940a42c1466e265bb85b003c4924efdf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3145dac992b47f8ec62cd57116e926b2a695cd59', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9382fd86abe8c3ff832936a887cfd3ec872e9fe5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:72bd03bf9cdac006c25d2947b019bc24107420e1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c2cf20118cf374e6ab142d13ac965876f1975357', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:684ff8daf5e9c4636809111bf947ace8333a8fdc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f660ce5dfb237fb460d6773877bf2c327c303292', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ca', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:51e8d8569ada9cd71270c061edb169a276809ee6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd37ba38e78249b1b3c68909910a606617147412', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:64af8fbe274f3b4f2f385527b06c454a9c0bfcc9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:af85e83c2e3410f3cb934682fbd3b9e09c299013', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:493185b0256586eb8e84dff43a0e2bfa2e78f6f6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95307802e40d7d97eb04220e6459af7394c95743', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb67b26db0959b63c63afd34732160c235a931d7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f0b8927e9169ed86da6341dea7f7459c82daa149', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29ce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:32:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a9fa2377645f96ec7989fde6de6e4c6326dea47e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e6256b695468f163f84db6f55c4e110736101611', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29cf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:baaf188c0d6f5f18dc1dfd5b6c07c852a90e54c8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4400e9f589e6c4a8dbd2269cd0fb2dce3829e40c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:01a624b16b3152e6121c4f1ffb71089c690b45da', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f5d66c25e2492f29f47ba664692532774a09a36f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c2975acefd11db82809f2d9b22098e69a0cfb978', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f1a450fc47a71c369bfd2510a9763044e7fc679b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5af55fa195250c02e6f7d53dc8fddf41fd2b8b3a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8e17750b7b4c7cb753c41bf6e7180b8848e60d20', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e57f1c46c43b1b7359bc7f25681d12f4e6de13e0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:98556da5df76853d7b39a46767f2575361455bc0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c54e2c9a52f460af5530e051510b368e18b58c4c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab63bbdd1b8ccc5940e609805bdb4b85f62f4d97', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cce1f4440ed9fcd5e1710e0b7456d8a482a885c8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:67c5b66a238c06c57549cd3a509d4bebd88504a2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8b4dcaf3a809f8c3097ed126962bafea1f4af168', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2d9dd73fba2ce35945e5350158a428c06d689b49', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:66a3e3b7b28cb75eba8200f979bd84ed929edb6e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bee20b8818bbdd9dafb49018f671db26fe08ff79', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5c6cae5c27d720207bb9a7b59edf4f2839891d67', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6e760966a6f4cfcc85a2e110b45a136f11e35586', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29d9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f7c786227d5c005d931dc6ffd10e1ccb896c9526', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6333c17d696168d295b0bb21c4be46fcae4cb6bf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29da', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:40c0c448c8faa8dc4636b7f0c32be6e2db1e5203', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a208e6dfac827f406281a34e9e27ac9f79a86efd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29db', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:789aee61cf65c14952dbfc660c200e011147e618', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:022d55cc9c052cefc01bf0e416691551de28c4d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29dc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c47dd1894a4c22b0ff08bc78a8e0c69d6c18618', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b11ba40dc2f847b8f4333d125c2f72413c3dfc6e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29dd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54c6d0efae885216932823afa045a82f14c71de4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:59f8e3b945f34b6f38c13cdb1ec9804fb4e1c0e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29de', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5d62f53f4a01fc9fe442292985f9033ebab4f619', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4ca4876eba90d7daecd5c75991379853dca2d959', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29df', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e8ea155e09b221063f92c259e601fdc762218555', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:705a5f2b4866642936515a4b71e4a142500b0126', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:688078d6b55ba87971bdca1f41e9ceaf7688b55b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d942b8c3c05307389421ee9f4706e6dd71e1b67a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:20d9554acfa0739da6d8501106ddaf5d71f7c56a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:089002af6f429ab2b8551b60f97751b347842d89', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:42f694619cf7e3191779a33b4f2c796fa550da07', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dfc769d43d7eaf9db10cee9c7028671866fa5688', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ff1a5537b5e930047c7e663b5f4293936710d1a3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:333521a5b7df693dfd38a87c7a635b0aaba4d286', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:71e759b0eca37cf7507c47dad7802334ccebd8a1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:248bcc27cb814a966680ff2cfb5cfd85a0fdafe3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727311fb139cb87e29e5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e111fb139cb87e2229
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2903
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2904
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2905
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2906
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2907
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2908
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2909
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e290f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2910
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2911
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2912
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2913
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2914
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2915
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2916
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2917
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2918
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2919
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e291f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2920
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2921
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2922
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2923
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2924
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2925
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2926
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2927
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2928
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2929
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e292f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2930
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2931
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2932
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2933
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2934
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2935
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2936
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2937
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2938
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2939
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e293f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2940
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2941
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2942
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2943
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2944
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2945
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2946
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2947
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2948
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2949
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e294f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2950
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2951
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2952
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2953
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2954
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2955
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2956
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2957
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2958
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2959
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e295f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2960
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2961
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2962
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2963
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2964
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2965
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2966
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2967
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2968
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2969
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e296f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2970
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2971
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2972
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2973
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2974
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2975
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2976
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2977
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2978
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2979
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e297f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2980
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2981
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2982
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2983
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2984
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2985
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2986
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2987
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2988
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2989
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e298f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2990
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2991
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2992
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2993
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2994
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2995
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2996
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2997
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2998
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e2999
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e299f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29a9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29aa
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ab
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ac
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ad
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ae
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29af
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29b9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ba
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29bb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29bc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29bd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29be
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29bf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29c9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ca
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29cb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29cc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29cd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29ce
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29cf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29d9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29da
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29db
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29dc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29dd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29de
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29df
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727311fb139cb87e29e6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a00da1a0b129d8b5cd9c9d596b013daff30b7c86
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b500f7167e7a9ba97964742c01026ebb19183cee
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9b907755e799b4950863708db32106ea984f2e9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a28fbc2084b3d54ac405bd0be77059325944e8d8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c69083f2d39dd914b119fe369a3180553ecd0ae0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5832c52ad8725711a08a04a17544688b66cd0ea7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:919eba4691d44bea792f390aff1f761dde51945b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8200eb4ea598210daa3e4d337db363b67d814df
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45c47c4f4e2656560193f267cd7511150e8b3190
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:976c1d68e125d512d671326a7703047f8ceed72b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f8e91627b898516fb2557e4179596f2983f10cc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2e4c2e2f7376e9196d141a596943368ad7fa3861
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:267fc513b5dea01d2988c9b91f31d9c4ac22ea76
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:702edccd31665086cfd1591b16ee8631577fa203
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0bf02b66c038d318f69f8e21d9a0965eea365e4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ec4ba8b780d23c8318b75afec1f6cb6eae259f4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3ebbd22012829e78cd56fa9c251d703a0c5d383
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83eb260eb87f45322e0bb3ba5ce6d29ac7110784
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73e5ce9970fefc95190d26a5fc49970922c6adb7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef2c661b76c7d20c3e33f962d49c1eccadb67b37
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a45d5ed69c9a141a726891e6fe406476dc5fb1d8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3021dda9b9714a0e3b42f57274f3cc04c366264e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ccbe1f0c0817ee8dd991cd66159851e21947601
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cacf0a6a9223e4c315761b725c405e5a48de14b2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:75065883e0e0eaf3821c571e5cc521844b3db071
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b358d9ff9c9704baf66ca8221dd50904bff88440
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:51b42c89e742331a9242f3bea996a376838d6878
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:acc33ee02f03174d70870b1339ce3a44858192df
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0d3dc04ec924768de3b019cb8a695059c114db6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63906ee7aa22fcd5fa5d22a9c92e397110473efb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa720acdf1f5594918f65451559276e99232da36
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8173e62c1f6fe51e72432705aa9e8a467f8ebbfc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4cfdc43061aae78aea5c6df2a163bb70d3d454d1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a64d2ec7b591253206745c54ef9e2d247768f052
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db0a5d30e12214f0e1db6a5aad093c028ef4aa3a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:07b61c08ed2e806c293a3391fbdf23fb36f6006b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0e223d6dbeac8ad5b97a63c312d4417bcbf327f0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7bc2f7c698e94ea80101815af3bc8a8c8141a26
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c8ca99bcff205d97524ab01a1226d5d19daf6576
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8699bd585d2531faaabbd55367d2bae67da29c06
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5cb8cd8ab25b1d02324ab42712e8186f33de545
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46f2703ca8b04cd2c346f6035c663b2361407a40
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:515902f408fc037b646e6da5e52209ede0f3979c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b8afac584b8af03948aa559edad5393dfc1d750
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a79ea643ce3037c362b7d3a0d434c4c85ceec231
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c726e9d683c953dfc47b81a252990d495dd895e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41b3d367b304a3d1d7c848d9635c772b277e39a1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ce106eea03b1860682c48d73fa2fa04728d88b8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34ffb847b5c805428c1c3d670bbdf0c5a0764f0a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ed03260d22fc929f00d0e3ef3ea20597207008b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ccb290616ba78340fa4e9f959137e51652b2db85
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7662d2e9884b4cf9b18b273242ee1a83cf9ba10
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66e3f95fd65c120889864171ab53064f785da2e2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60c7a8ef80e6e1d06b56c3c3b126c3aa715e111e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0334e58af957ff32bd9ed8549d3b6d03e5f1bd5c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abef4a50c793477dd5549a4591795290cc3e992f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e2a31d6265e51e62d5ffe54a87bc520191f45499
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:335fde32a5ec61bed85279cb36acfad67f48e4f6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f775b5fe3ee3b333d0b81e316fb743fbbf3c63e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fee8d260ecf9c05f40eb23934dfe96554dcd9bd6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18fe239857804f0d243b7a56ed6a444bbe538d35
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:afb67fe445e7e96c14e9de8c3b91a5785448ff0a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a59806c6f17d758f4bf8a655b16d5ab4d20d7c48
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ec4fbf1fa13b36d4e7bcb9e5feb46c01d3f731f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62effc5ae7d66c8c46419d1a269285b49260d9d5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9ce70a8219fda9a4e0fea8be2c1a88eb8502cfe0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18dcdc8613735fa540c497871c88260eddf31ac6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de346a6f9875d7e4754673875c3602e454fdd981
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:509c24ba0482b01d1876742cbee81c377c3e8a5a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c15bc21f6371fe3b9cddbb47a6d1d7d534004343
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf9e0038794a5cf73a46d0a5303771b7aaeed4a5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:313f3991a35914991cc0bf1b726835ac4844d0c4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a978f661caae4222d565ab771125360e70c11e12
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10761dde14d5da41cc3ea69919fd670590ac8d8b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0a7dac946e44c39696afdf4915dded4bf121afd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e144c3965e2de86f254e80a1ea0b9277d3a627f1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38da70f951b17f34857093d77dc043ca3ba7a23e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:17af10421a82f47f7b57a9e04e3c039832156c28
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a5eb7b36c6a3f089778ecbc2e997adba744446b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf578c709003fb8cfe2adca32a4d9d19c542077e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6147f63230e380a9eacbab500b20283c79a23c0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a574320d474d7768ec479826eb718cd75f66e8d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e416f408fabc74ce6cc56ce05fc097c8bcbdf765
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c556e7acadcef7b88c47ea75eec65bcf3cb6860
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c07df5b9b94adaea0725f93184bf77a80f5229cc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65ee66df945b2c9fb13c23fed8a8b757d775a15b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c3ee36130d333791732803d07e974fc5d0866e0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c761644ff51e9c9aed838e61d8ab918e485a341c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8afa9204bfc43a3ae01484705b28825acc177b30
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9c10776ab2c90edc5c8d16c767e244c92f7305d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1bce74711174a19e2bc7c0ffff5a3fa88dbed85
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10c681d47ce06fd637d2491c64f983a232706dd1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b7dc5d3be441b9e5ed317bd8d4472697ad3e784
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bbe65d8643f7071ecd54c1f794f37b447846595c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38550d0a153e1140ec2e3e01f9b3dbaad8d9617b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:312427d0476b4439656a62fe5261ea73321994b9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35739032232946d2ac142ef151454fd602972f1f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dce4b0a586346e8de0bf3544ca0290113e5899f0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54861cd9d1e9d603a9aa8d835bf7d5e65f1df340
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b348912d4c828556058d8dc6a5072ccb65b97412
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f599ccf3faaefedf8c2fcb1774f01a5b91b8d52c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd46e4e2c3125736528b6d05a993d519eb658e08
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3d092b0a4980bc37537cc8203b8a5c9665eee74
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b064b987bdc4d0bf23876b896c4b4644ae9b3b93
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f5a925b57510982131f63c6d16223a619c829cf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d0f849612160aaacb9f0c15e36a8989a5c9d01c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:548441ed93c103fad4fccdaebe5c7a627149e0d8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:985679116371039d79158cf273e9d4283a9f1466
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f3796a2ac424c522d4ebfce4d908ab4c1091878
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b02c6765d3a306bef38bb80ecfa17e79cd827cb9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:636047ef6225d659b8c2ca93d465f03c93e98845
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:457ff60026cd564dcadbd712fd10edd54123150d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7587eadee603633dd1616eac1d4b82f2e79de0c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee2ed7e61d97f7c1805e25ca01d74056573e847f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0088bd50b58f749048bae364fb0dc1872e6c337f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:743257d16ba8fe4dde2c0e05416d1c4a96c7438e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4eec7b54bb15429512c74d37f9dbe0e0f174287e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:63fe4a01b47158a95b0f87dea9ef734799accd49
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:414efb57ed837cbd49f9d8daa645b3d8e33b05a8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73dfa67eb76b39f5f915067afd0fd1c0a07ecf22
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cccbd61d953b5e0c470ebb55641ce2338810941a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:edab993b31faf0657a2825cf89a52d0b46244e9c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:800bc34e24e5a7c1331b5f58eb0eb49a2619f07f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9117f966590518bafce2ae329bd8e314b7793855
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9c91940e92d6341d6e5c3f1c27e0246ace561ad
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a13290d923d867b47b30879ec0de2d64aa69e7f5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4ae8aa58334775e435c22ee01200c424a8065a7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b69e6f8da6dcdef44fcfad3a89805714da9a880
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a258caf0bc54107648124656ef17999fb3ce484a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13e22667912c06c65f78823dc32c21a2913973f7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:261c686da311482fe4d1a7c48e9b47fc66a4844b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7ac97573ce515fa1fc1b52e7d976f0c9166382b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9d0aab776c6fab1df04eea7631848e22f2145e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f28fe2f3bff49affbdad9b8983fe3edb16a72bf1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3a7a0ed84326541b4d81e264d6fb6dde430bb26
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e0355d3a1716eb12c16b19de13e8771c549b903
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c47d8989f18db1b75803f9f6a9cd72cfb3de59e3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca45610b943660ebe954a810e979d372f2855ef1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7f39e0a6c578dcd39383ae01b10cd2c308250b6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ccc48f98a50fca6150317adcb3e5c1dcfa0a0edb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5f78bc7d3884b88883a42dcb8df9c5de28ba1e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3035b131ea4c5115191d02ab441b48006963bfbc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7f7a24424704132510552b8f8b453977e8a11e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f160c805f4be07aed35d252e89a8e1ec2683e0a5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88fbb6de642d66e01cee3935fb4f893c5df14bb0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc669c2cbc44e0157feea9419c1a9c6c926b00de
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83bbdc9f41db058fafeced62e55cfb4ebbe22952
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:858cbe52f55dddfedd0b924a613f78f522d6df52
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9144da9fd25a310644ef45dadd778d7ab116a4ba
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc8bb265b695d62ca2344740459ebc087a1e339b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3c2452cc0d06db92bcf15bbbb3c34cd68b0eda2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e69d248c1d750a23132ef7e3e2ae309fa9bce170
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b87d5716fc76b2078286f97812571621cac2ad1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2b84e4e17ae190d1ea76e02d2d97e0891e426dc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b570f255ff4dd84cff76201723c23f4d2381fafe
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea13197ab80b9afc3978f2274563577adee49a6e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c5584176c37635fdb706a87c7579c630e2c17c1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f5b31f6c02ac383c6d372387f3164ed5e95b99e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:613e29ad8f8c55ea3674ba07176e765143e7f0a9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84cef729843735220eec8a7983ff040845c27dc9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85186da745c2abeea13e3fe26e70352d3856ba4e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d82f8fabe7c3c5f434fe3d780265c1d82d5ae82
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1871e26243f6ccb94ba2135a45e9c52a170e2351
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ff952c932105a9a9b614cbf272bee8ace12d14b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b11357dfc047ebe8ad045484f5016da767dfb005
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4fd1a8cee95976f1243d5f6f6e819b575ffd3699
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:186dd1e10ad14c20f444f8f7baa53950e2bead35
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7d6604e838d9214f745bcd6eea89f50daf157e6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8bf44d16ff7546b41535df0f587d818e7cfb700
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d43e65c1a2ef4daf29b50f31a8413e540aeebf72
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5481d9e898f57bb0a8ff638c9473c685a5dcf060
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f092f05a535669f419aa5824f099e4dd369f079
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0a2088243a4de980ddc00fc7f36f54f4a6280c9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93bd4a29d56892983f276226f0203a2f7ce03ee0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab02cd47a816f9cb79b3a4da8eccd345d3b46835
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41290c9ebfd7e705eef748cda516e2f8f770a64a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea943c56df5cdcbcb8c2dca2dba77345f35e2f51
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:097c848a3ea24bf2466efe60567aea7093d0fd9d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d7a6a5ecb89516f6a74c6b582ea7dca0af56198
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34f5e9ed1035ed62c1495c2a89be2fe17e21a640
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5cfdadd8239042f45e33e663c75383e6902a767d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:065ab9151524d748333fdaec59d275afa3bfda21
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4314b1da291988abd976a97035739025e235f057
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e63ae15449a4ebec1d7d681896056747f905f5c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:623f507e38c97e53dac9347436ac3fe017472948
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0ce78c37019649981cc07892819be202a20b363
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6cbd58411eacc952ce626b8546c1634923b75d6d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:faf092aba43edd485992e2f5a3e15187b1b31718
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2523c292f2de7e8ff966cb89c3c00c3ae381d70
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf3331211d5315a0b67b7d7777b901643df1ad87
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44dcf63c0593b70a32cbea96d0143e2ea016fade
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2889eff88319473c9213c8224720cf1b4b5f8d6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:857ebf6e94d9792f04850421065c9983d9c48ebc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a611570a493991c84f684c685fa16359b485a9d5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42e43833c05387f49ea7b6c818d85c398a83dbd0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35f0f383d4a67b6f329a1f3d5fb22f92e2aff2dd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d9869341a403b57f22348d8f2531cc578078d20
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c0805dcd624dfb0c067a0a5fd62baa060960c8b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f94ec75602b7ddf6aa1398a369fe3c6222ae7a76
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c41f4690552780e052ea271e790a70659ba97755
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c759e8c6b6f8e91a006094c6a42fcea205e230f3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa13ff18f4205f336e5526af24903c9f3155f1f6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be111eb2941f6d2c3ff8b3fb6163eb5309fdebb4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:912f5eeb4da1cfde2ceb4e75e80e4ab42f65ec09
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:17e312b3da9a9b63d5a92926bbe96937182cfdae
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bcf421908401890a5b7be35e79dd87616735b6ab
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28099f40ab2f36394c636f4cb8f38591a315b526
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e761699f8435f793929fd972a85d637c3be45e98
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6f873fbc0efb85fc20458f72d64dd314c57184d2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1800db095e7d655ff477b105759ff58a13927d65
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7c16ab886c260756bfee976baf5e02c8f28cdbe
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab8aa321b79b8fc4ac4312cd665e10a751febcb9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1dfbe1d759298d5b86fb36f452e10df65041043
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8a6c2208d5663fddc37e765c4880c5a6eee5a7b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:847a8d1f45accaae6c015725089772c897996dec
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5932f0ba359ccfcba5c892436f939ee969329907
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:397ceba165621c4ebb8e8016b04f68f474722dc5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc14eea470b2d7efccd797b3bc5f68b7af3d9c14
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c133fe93bd6ebdc69e4edd8d69f98011a7fa03f0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3bb958ff4e11c3eb4e2a8ca0ceb5388ab1fd9ff
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc50295b98b6b1fae89f1ed54b1b0d06bb63da42
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b52a4cec1296aa2cc84f4b41233c1c371dd5b62
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0bc6857a5a7e02e28d0f542bb096a247273b9ec0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:988b2f7e7bcc21b70682fc0d58706384ae58892b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f97087bae3b41adf743597ae9b2b47102cb1486a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a748b97ba23137a5ed966b031ec4ebf5bfe414c2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:21a2832a5b3a8901f310a7a0e81eb35751d0c189
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c1a29b9da127722f605c75c035131af2f7e3566
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e29892a82e4fbab223d58d0a254b566d3c3250ad
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c87850654f8f5a5c49b182157331ed62f71e8443
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3258de4e3b3ba80272052257e2f0b60d83cd2da
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44264d7c075c74f7857d56926d2e51a8c5e38a05
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7254b9ded248fb0b4bbee7feb297630591173e1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31c50db79d9a90bf6163605b404369a7e1d57706
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ed2cf7d407695b567679ac87710a7703c9e744a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd16d92240f1015e8f626a06f50594f54a9330d7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d77fb205c206d2576343aa7feec149f6c136d9a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0bbb521699d7e55cedbf8d81e8d25d66d3a20a64
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee5b95903f196293adc7beeb2dce196b6f7f0487
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3335d6e283e9a391ec0142c1b7075f477f79727
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33285b866e522d0164bd0133f5f6bf7853e4735f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d237287205f97c129df8a315eb9d5a7bdb05e6ae
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f08aea0047fb81e3df486ca3fce7ccab036bf1dc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:febb7ba9870fbb6cb56d0ac4eec3bdad8650f0ce
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0bd69efa625b329aff890aaeae6c86d6b3f97fdc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3bf130719d5a274180e449c0a9cd5967c88c09b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85c7931c2830cc40be474fbeaccdd7aae5a43073
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cfe19d27445826d3be8c005b2af93055972240f3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1cbae018485b7655c2c63c6ee51d486167304336
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5f2233521a2a9ae07913b447081fb1dbbff9594
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:452d52d7037e6e731a3facafca614304e87a6a65
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04a4e25ea61fc89cdd5e4b3e253d779e0da4bef0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e4c218dfd60c623f9c1e641e9c74709625639b5e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c39a2b3f43a13b0c1b635a1098bab8346886e1b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f36720e0ceac270572b2c141ccfaed74264e595
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:927260b4033eaac075a535cacfe72f73282e5de6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13ca87f9cb1d33cc90aee95620f02a39841844c7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62624f8f848e2e4607178489b97cfe63f41f7388
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:62e2d004f305ac8d355c5dcc3e018ffd34aafabd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2733ad1ca601f9e146de08ca140e5aae683e24f1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b3879b68bc1941318d172cec78ca4c5fd6c2ab73
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:254066a32172c7d469d802b8958c39b5a41a428f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6bd1ab7c555a8675579712fc11c4aeb02580be5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d076a1cbaa6bfde857ce59fb034c8300292782d8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b8c727223d440b86c0917cc13e3600484f98d16
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de0e935cc16392987d45b977e8624410825bdd3c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bfb8e0508764db0018d501c5a79e3cb0b19793ef
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a05d6aea86cd33b5a86f7584b2f3d52cc3fab1a5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7999ee5e114696c92f2726d38224dff73608a193
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:96c1d40f59e8df0e537d0154ac7e8c9f847899d1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01f5979d93a6a83a802a4ccb3756cb66a5aa15e8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f21070a645942201be9e8c7f851e969eab41c4d9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6316a9e90408badba042e5bbab9deda6e952003d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4167ee551078ddc7c6ff64af0de91422715e8e4f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:286261e35fe0b5a1d38c2fd5bd7635be8555915c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11231e3cfd0f539e29dbf4a9f8386065a2b7fa86
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:729524e3c2c679bd22cd80cf50cba4ec646d575b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:daf7b8c57f05209190bc0468ab125f7687ef71a7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b83703599b4a6438be05ed53e550330799421466
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f1f659b9e972ec17f7411a94896d753f360d558
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3f72ead4228d5ee6d17bf90de643d936e1b0b0b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8de587ad4d28e9d888abe42b91dec7351a8e26f7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fa7bb684d63c646e679b518b7f3a6034ee55cde
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:51ce66405a8c815f1e232a77dfeea952cda28589
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e05319eda519374f3d649d443a48ef542b38ddd3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1f0fbdbf1209301151186774093aa0cf26353e4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da031111ac9eef1c72c3b1f46cfe95d6a38507fe
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d8a42493dc15d1d8d78ee0227bb9be2bb20122e8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ef247c2db83b2a8f606ed9f0db00ab492d6b8be
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b09b6c7bab50480f50c0a248ce74c8de7f7e89db
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff63de6b885cd34c4f799b8e109024cbf688fdb7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ceece0170c0432241f01a17873f28d9ca986f6a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2c3d023e85a386d9b9f158d0e59e9f7761e14e98
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d7bca304cdc4bd883cb4d17883aab42da5f320e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13b4a4a66e61c44adb918bbb5c5b3812195d8694
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:07ddb0a9b52533f5941b3970135ca9705198bfdf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc184d40d7f14b064fcb352eca71c3f6661c0471
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fdf0da340b04ef441ce4cde0a6226d33f1a09b82
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee1ef79fceb8ffa577e35773c141262eee9295d3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:967c48eb9120432fda4d1ad55ab1a8b528267182
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:07d0669db847b793f154751d813749c39b76be9b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:130673da3ecb636f554765329bed4ba9b0440f28
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f431b9d04b09b51bb0ae4cf02ea806234a3bcfa5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:447a3e09175ba9df54d77d667cd5ff464f5a7212
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b57c96ac52a0064580548cb9a24623faf2de849e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac31043a2a0da6558b26bbfae0130a7d53c6752b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b8c3ce582895376f025fcfee1a52fe77dfe0566
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e521a068fdbf633ff2d776a8e7687d253a7fe61
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff579067d056b84bd586a876420902e8a394686d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45e814428f15093510c3ae264743faf94b19169b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:824fc489e14c41f8b2f7a04187fc6bbd2b07e89b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bcc99ff9d1575761e42538836160493eaf48c655
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:820b872e81dc0a0580b8ff0b6d15082fc5c89dc4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9873feedd2d1d126a5e4eab4106403c3c92f4619
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99946b0d6caae1b807eda961c80ab8196895cd7d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abc131e607da3d8f28d1fded9bc7161c4c478879
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fa80952eb84e61269b6c14df3e5aed456239b8c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0775de37ea351250bbf53dadb707328aff3751f1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bf2f15214f8ff983766eb4537f41ad66d009728
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3113c7eaad9016e021f47ce2edbb41b379de0607
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2dbae44cec69c00d2188bc275ac07c4113a4b67a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fe19f218a469a3f021a5538548d08f8c14daf75
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11aadfe31aa6a3a6b3e75ad5c295957b9635f8ce
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d525220c0e7961a724b150b10af96afeef53cb7b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f51308015ae9f8cfb52ddb0d47a759531fc00dd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5fb3dddc88f92076907e0c09db1d0cf7e0e0986
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9bc0f66d01d141f645e49aa2897695b9eb423eb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e358de1a89ae181e3a70354d0ffc675fc118b3ce
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c73beb6320deecd0cdce853e2be04526cb5351e5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85bfe97ed0ae6cfdcf4b748d5cca5b8549deafdd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5be9c7cea5863c8f45432834cd829cf586f17cc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc355e29315f775d96f677105e4807e3af805808
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5e0bd5afc323263e4c7f88d33be38e97a73377d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4dbb691a85b8564b5b0642cd28bc47e9ae167f6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b860da3a646156d9b0bd80e7e5cac74324341179
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b15cf20b620be781e3bbd4d0244ed87ef3f601f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c9fc80fabe9a9200d6f2e78bc474483224d367f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6fb0b9924dcd44e9125b3e90dece9ae8c5d8f48d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:229f5512180bdc291a7597aea5927280c07a373b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:003c635265224d96e69ce315b5cc648921b3053d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9ff14b83e9f814931a927dd4f9f6d4560a125fc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:caff893bd76b049e61eb09acb315edd99ac6afe6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7827aa0ac5148bc3a1b5cffe3248c603a565e71
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7af216212955a31b6fd96834d16bd2c325001a1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0112fae4ffc3d69c1752151f50ba52fa043c7223
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:372bedba5e781fd753372af32f879a20ca5cadc1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0dad58ab59171f285c32ed2a4a8ec56d58acda31
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f53dce476ec7f9b9dfec61242fc193f198d2a4ea
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5e31dc6d67154d17599345367fb7e0f71a4269f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cde70c92d5ca06ed6a469eef7fcaa80972589e49
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:137bc1b58de66984ecdfdad9ae870b0081cc1746
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04b7d240884702dd10219ba9d4bf639441da6ec9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a6034bd7749234921c15181d6b52db551e62bba2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04756119ab6eba850d67fae612d6864c25f70d25
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:135807de3db99568c5554ff43cea350c6a7e5953
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67663c3ae66209e0496b9c49cbbd89b666ed5be2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:670b3934bcb4a6bc446b8c52e6e8eb53455a3ec9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32ad74422f34c39518bd3d7ba8767f0133e21b0b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f59166a03f55f71289f7812b3d2a78b8fe7589c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c90b260f6f76ab8cfd97b99ebab9dda4351a968
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44ffc3a08d84eb2cbfb3e6930c3fc2d96bd87a37
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0fa72b1d15e1048eeda27c546dcf356a934b5fd4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d76872cbb4c2c8692442eca57c68fd76fcc9e63f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3025be78243fd0783bd83043e3d02c386ba0439b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69e68b4b79a330bbc3fb818de0cfbadf8a80cb99
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a14981e05ad8f651cf6bf5e779b975dde521bd9a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32285ebb6d974ebb41589c623e8a6fe72fee2b3d
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bfbf988415ec731468e817d17f5962ab96925426
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:598defd387ef061b5048c0695922b21953654b39
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df693879b11d0ac63fceb9d3836da8c7a82b7006
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57019acefb811effed126b407c00b776bfe98927
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbfb51853ddf191e9c8e17377749e3ccff19f3cc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f438297ec23f7045f4b3a8be789261785e9270e3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40660df7398046b1b96d56600d889fe95aa2c432
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed37e65c5b81086540019c360d253b5a483c9cd3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5cb7a2d7cd3f38fd95635f3cee6b63ecd56c5dd3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89af07659d70562d455d16281cee9afe08977edb
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6a11d81940a42c1466e265bb85b003c4924efdf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3145dac992b47f8ec62cd57116e926b2a695cd59
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9382fd86abe8c3ff832936a887cfd3ec872e9fe5
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72bd03bf9cdac006c25d2947b019bc24107420e1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2cf20118cf374e6ab142d13ac965876f1975357
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:684ff8daf5e9c4636809111bf947ace8333a8fdc
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f660ce5dfb237fb460d6773877bf2c327c303292
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:51e8d8569ada9cd71270c061edb169a276809ee6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd37ba38e78249b1b3c68909910a606617147412
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64af8fbe274f3b4f2f385527b06c454a9c0bfcc9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af85e83c2e3410f3cb934682fbd3b9e09c299013
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:493185b0256586eb8e84dff43a0e2bfa2e78f6f6
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95307802e40d7d97eb04220e6459af7394c95743
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb67b26db0959b63c63afd34732160c235a931d7
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0b8927e9169ed86da6341dea7f7459c82daa149
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9fa2377645f96ec7989fde6de6e4c6326dea47e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e6256b695468f163f84db6f55c4e110736101611
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:baaf188c0d6f5f18dc1dfd5b6c07c852a90e54c8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4400e9f589e6c4a8dbd2269cd0fb2dce3829e40c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01a624b16b3152e6121c4f1ffb71089c690b45da
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5d66c25e2492f29f47ba664692532774a09a36f
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2975acefd11db82809f2d9b22098e69a0cfb978
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1a450fc47a71c369bfd2510a9763044e7fc679b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5af55fa195250c02e6f7d53dc8fddf41fd2b8b3a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e17750b7b4c7cb753c41bf6e7180b8848e60d20
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e57f1c46c43b1b7359bc7f25681d12f4e6de13e0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98556da5df76853d7b39a46767f2575361455bc0
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c54e2c9a52f460af5530e051510b368e18b58c4c
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab63bbdd1b8ccc5940e609805bdb4b85f62f4d97
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cce1f4440ed9fcd5e1710e0b7456d8a482a885c8
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:67c5b66a238c06c57549cd3a509d4bebd88504a2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8b4dcaf3a809f8c3097ed126962bafea1f4af168
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d9dd73fba2ce35945e5350158a428c06d689b49
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:66a3e3b7b28cb75eba8200f979bd84ed929edb6e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bee20b8818bbdd9dafb49018f671db26fe08ff79
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c6cae5c27d720207bb9a7b59edf4f2839891d67
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6e760966a6f4cfcc85a2e110b45a136f11e35586
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7c786227d5c005d931dc6ffd10e1ccb896c9526
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6333c17d696168d295b0bb21c4be46fcae4cb6bf
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:40c0c448c8faa8dc4636b7f0c32be6e2db1e5203
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a208e6dfac827f406281a34e9e27ac9f79a86efd
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:789aee61cf65c14952dbfc660c200e011147e618
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:022d55cc9c052cefc01bf0e416691551de28c4d9
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c47dd1894a4c22b0ff08bc78a8e0c69d6c18618
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b11ba40dc2f847b8f4333d125c2f72413c3dfc6e
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54c6d0efae885216932823afa045a82f14c71de4
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59f8e3b945f34b6f38c13cdb1ec9804fb4e1c0e2
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d62f53f4a01fc9fe442292985f9033ebab4f619
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ca4876eba90d7daecd5c75991379853dca2d959
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8ea155e09b221063f92c259e601fdc762218555
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:705a5f2b4866642936515a4b71e4a142500b0126
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:688078d6b55ba87971bdca1f41e9ceaf7688b55b
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d942b8c3c05307389421ee9f4706e6dd71e1b67a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:20d9554acfa0739da6d8501106ddaf5d71f7c56a
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:089002af6f429ab2b8551b60f97751b347842d89
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:42f694619cf7e3191779a33b4f2c796fa550da07
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfc769d43d7eaf9db10cee9c7028671866fa5688
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff1a5537b5e930047c7e663b5f4293936710d1a3
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:333521a5b7df693dfd38a87c7a635b0aaba4d286
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71e759b0eca37cf7507c47dad7802334ccebd8a1
11/22/2024 01:33:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:248bcc27cb814a966680ff2cfb5cfd85a0fdafe3
11/22/2024 01:33:07 PM UTC [INFO] Received an event for node: 67406d2c11fb139cb87dfb3c
11/22/2024 01:33:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2c11fb139cb87dfb3c
11/22/2024 01:33:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2c11fb139cb87dfb3c
11/22/2024 01:33:09 PM UTC [INFO] Received an event for node: 67406d3b11fb139cb87dfbac
11/22/2024 01:33:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:77ace9a50d2affed006963d8f5af46405e856044', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b648edb105be8dbddace689649b5eb1caea5729', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:77ace9a50d2affed006963d8f5af46405e856044', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b648edb105be8dbddace689649b5eb1caea5729', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:77ace9a50d2affed006963d8f5af46405e856044', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b648edb105be8dbddace689649b5eb1caea5729', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3b11fb139cb87dfbac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3b11fb139cb87dfbac
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77ace9a50d2affed006963d8f5af46405e856044
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b648edb105be8dbddace689649b5eb1caea5729
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77ace9a50d2affed006963d8f5af46405e856044
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b648edb105be8dbddace689649b5eb1caea5729
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddea232ed6c05dff73b530eee08f5a8cd5fde59e
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77ace9a50d2affed006963d8f5af46405e856044
11/22/2024 01:33:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b648edb105be8dbddace689649b5eb1caea5729
11/22/2024 01:33:12 PM UTC [INFO] Received an event for node: 674070cc11fb139cb87e21dd
11/22/2024 01:33:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cc11fb139cb87e21dd
11/22/2024 01:33:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740728511fb139cb87e29f4
11/22/2024 01:33:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740728511fb139cb87e29f5
11/22/2024 01:33:14 PM UTC [INFO] Received an event for node: 67406d5c11fb139cb87dfc54
11/22/2024 01:33:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5c11fb139cb87dfc54
11/22/2024 01:33:16 PM UTC [INFO] Received an event for node: 67406d2d11fb139cb87dfb45
11/22/2024 01:33:18 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2d11fb139cb87dfb45
11/22/2024 01:33:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2d11fb139cb87dfb45
11/22/2024 01:33:18 PM UTC [INFO] Received an event for node: 67406d5b11fb139cb87dfc51
11/22/2024 01:33:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5b11fb139cb87dfc51
11/22/2024 01:33:20 PM UTC [INFO] Received an event for node: 67406d5211fb139cb87dfc2c
11/22/2024 01:33:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d5211fb139cb87dfc2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5211fb139cb87dfc2c
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b045c76ccbc78bff00a6ecdca086472757ea2d4
11/22/2024 01:33:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd2c8bf498a3c7e82520d2f3e9af440a7c7a351c
11/22/2024 01:33:22 PM UTC [INFO] Received an event for node: 67406d6011fb139cb87dfc6d
11/22/2024 01:33:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6011fb139cb87dfc6d
11/22/2024 01:33:23 PM UTC [INFO] Received an event for node: 67406d3911fb139cb87dfb9e
11/22/2024 01:33:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4838629b72100e39abe27149e92f7364d2d16a36', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4838629b72100e39abe27149e92f7364d2d16a36', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4838629b72100e39abe27149e92f7364d2d16a36', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3911fb139cb87dfb9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3911fb139cb87dfb9e
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4838629b72100e39abe27149e92f7364d2d16a36
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4838629b72100e39abe27149e92f7364d2d16a36
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4838629b72100e39abe27149e92f7364d2d16a36
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10cdede5f07534f6f386c16ba7f8de50e4943f04
11/22/2024 01:33:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a82157fc48a4e8b35fb582aba3361a2dd313adb
11/22/2024 01:33:26 PM UTC [INFO] Received an event for node: 67406d5511fb139cb87dfc3d
11/22/2024 01:33:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5511fb139cb87dfc3d
11/22/2024 01:33:27 PM UTC [INFO] Received an event for node: 67406d5411fb139cb87dfc32
11/22/2024 01:33:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5411fb139cb87dfc32
11/22/2024 01:33:29 PM UTC [INFO] Received an event for node: 67406d5711fb139cb87dfc40
11/22/2024 01:33:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5711fb139cb87dfc40
11/22/2024 01:33:30 PM UTC [INFO] Received an event for node: 67406d3711fb139cb87dfb7d
11/22/2024 01:33:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3711fb139cb87dfb7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3711fb139cb87dfb7d
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d21c33cdc7fac246c542341c3ff3d5427b25f2d
11/22/2024 01:33:32 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c168bbc08f6599ab64ef0c84706d3e0d348df57f
11/22/2024 01:33:32 PM UTC [INFO] Received an event for node: 67406d3a11fb139cb87dfba9
11/22/2024 01:33:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:731818ec040ecff1c3252af4f0fea489360fcabf', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5e8100bb2528871fb307885ec8ff1969fffc9648', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:731818ec040ecff1c3252af4f0fea489360fcabf', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5e8100bb2528871fb307885ec8ff1969fffc9648', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:731818ec040ecff1c3252af4f0fea489360fcabf', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5e8100bb2528871fb307885ec8ff1969fffc9648', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3a11fb139cb87dfba9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3a11fb139cb87dfba9
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:731818ec040ecff1c3252af4f0fea489360fcabf
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e8100bb2528871fb307885ec8ff1969fffc9648
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:731818ec040ecff1c3252af4f0fea489360fcabf
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e8100bb2528871fb307885ec8ff1969fffc9648
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:731818ec040ecff1c3252af4f0fea489360fcabf
11/22/2024 01:33:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e8100bb2528871fb307885ec8ff1969fffc9648
11/22/2024 01:33:35 PM UTC [INFO] Received an event for node: 67406d5a11fb139cb87dfc46
11/22/2024 01:33:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5a11fb139cb87dfc46
11/22/2024 01:33:36 PM UTC [INFO] Received an event for node: 67406d5d11fb139cb87dfc57
11/22/2024 01:33:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5d11fb139cb87dfc57
11/22/2024 01:33:38 PM UTC [INFO] Received an event for node: 67406d5311fb139cb87dfc2f
11/22/2024 01:33:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5311fb139cb87dfc2f
11/22/2024 01:33:39 PM UTC [INFO] Received an event for node: 67406d3c11fb139cb87dfbaf
11/22/2024 01:33:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3c11fb139cb87dfbaf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3c11fb139cb87dfbaf
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d7454882d838bd83fd535eb9c6e59c8c403037b
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fd6470b7c8cd73d92d46a1ab5b19dc7147f9842c
11/22/2024 01:33:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be8fef416295f8b685ab105ac8dce6f52928a9fb
11/22/2024 01:33:42 PM UTC [INFO] Received an event for node: 67406e1911fb139cb87e01a6
11/22/2024 01:33:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e1911fb139cb87e01a6
11/22/2024 01:33:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e1911fb139cb87e01a6
11/22/2024 01:33:44 PM UTC [INFO] Received an event for node: 674070b111fb139cb87e2147
11/22/2024 01:33:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b111fb139cb87e2147
11/22/2024 01:33:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674072eb11fb139cb87e2a3c
11/22/2024 01:33:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674072eb11fb139cb87e2a3d
11/22/2024 01:33:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674072eb11fb139cb87e2a3e
11/22/2024 01:33:46 PM UTC [INFO] Received an event for node: 674070d611fb139cb87e21fb
11/22/2024 01:33:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d611fb139cb87e21fb
11/22/2024 01:33:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674072ed11fb139cb87e2a44
11/22/2024 01:33:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674072ed11fb139cb87e2a45
11/22/2024 01:33:48 PM UTC [INFO] Received an event for node: 67406d5f11fb139cb87dfc6a
11/22/2024 01:33:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d5f11fb139cb87dfc6a
11/22/2024 01:33:50 PM UTC [INFO] Received an event for node: 67406df011fb139cb87dfeff
11/22/2024 01:33:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df011fb139cb87dfeff
11/22/2024 01:33:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dfeff
11/22/2024 01:33:52 PM UTC [INFO] Received an event for node: 674070dd11fb139cb87e2215
11/22/2024 01:34:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3d116efb2808dbf6f58fb924a30d6d6e2afc12cd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070dd11fb139cb87e2215', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a84e76ef889d5249fa06e33a70bbd7ceaecb907', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070dd11fb139cb87e2215', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:34:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2cc61f8c943a42fc13d6a04cede35bdd017a3607', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a930b1ceaa6f507a9a2478efd929b685d42ce48', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:34:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f3fa1d9022eb9d6f56db88ad03ec57303c78a94', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f84900d814181c00125ba114ab9b62ffdc2b7179', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:34:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:670f8e5abbda72133b2df20598e6ec2af539c51a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6898a7fa905ec92d4a8019f7de479740e9be5f4d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dd11fb139cb87e2215
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a53
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a54
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a55
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a56
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a57
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a58
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a59
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5b
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5c
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5d
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5e
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a5f
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a60
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a61
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a62
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a63
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a64
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a65
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a66
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a67
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a68
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a69
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6b
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6c
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6d
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6e
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a6f
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a70
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a71
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a72
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a73
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a74
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a75
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a76
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a77
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a78
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a79
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7b
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7c
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7d
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7e
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a7f
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a80
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a81
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a82
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a83
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a84
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a85
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a86
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a87
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a88
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a89
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8b
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8c
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8d
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8e
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a8f
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a90
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a91
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a92
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a93
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a94
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a95
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a96
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a97
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a98
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a99
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9b
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9c
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9d
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9e
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9f
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa0
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa1
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa2
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa3
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa4
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa5
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa6
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa7
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa8
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aa9
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aaa
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aab
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aac
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aad
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aae
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aaf
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab0
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab1
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab2
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab3
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab4
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab5
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab6
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab7
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab8
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ab9
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aba
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2abb
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2abc
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2abd
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2abe
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2abf
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac0
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac1
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac2
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac3
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac4
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac5
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac6
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac7
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac8
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ac9
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2aca
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2acb
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2acc
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2acd
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ace
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2acf
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ad0
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ad1
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ad2
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2ad3
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d116efb2808dbf6f58fb924a30d6d6e2afc12cd
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a84e76ef889d5249fa06e33a70bbd7ceaecb907
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2cc61f8c943a42fc13d6a04cede35bdd017a3607
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a930b1ceaa6f507a9a2478efd929b685d42ce48
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f3fa1d9022eb9d6f56db88ad03ec57303c78a94
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f84900d814181c00125ba114ab9b62ffdc2b7179
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:670f8e5abbda72133b2df20598e6ec2af539c51a
11/22/2024 01:34:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6898a7fa905ec92d4a8019f7de479740e9be5f4d
11/22/2024 01:34:49 PM UTC [INFO] Received an event for node: 67406d3811fb139cb87dfb93
11/22/2024 01:34:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e7732046fc1944fb594414e2a116579016cbd862', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abed039e5aa9a0dc98265a98935679a1b50712ab', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e7732046fc1944fb594414e2a116579016cbd862', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abed039e5aa9a0dc98265a98935679a1b50712ab', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2', 'issue_id': 'maestro:d2517d7b4a93cc6a6b5343c9236a9efa11e7cf82', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e7732046fc1944fb594414e2a116579016cbd862', 'issue_id': 'maestro:7228fcad3cc25125c81e8a5d640833617791c213', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abed039e5aa9a0dc98265a98935679a1b50712ab', 'issue_id': 'maestro:1eafbc89d5e1c6d69497291884434260674de865', 'issue_version': 0, 'test_id': 'maestro:67406d3811fb139cb87dfb93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3811fb139cb87dfb93
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7732046fc1944fb594414e2a116579016cbd862
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abed039e5aa9a0dc98265a98935679a1b50712ab
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7732046fc1944fb594414e2a116579016cbd862
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abed039e5aa9a0dc98265a98935679a1b50712ab
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3dda6e23da70aab61b88d33aa3c433b67141c0a2
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7732046fc1944fb594414e2a116579016cbd862
11/22/2024 01:34:52 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abed039e5aa9a0dc98265a98935679a1b50712ab
11/22/2024 01:34:52 PM UTC [INFO] Received an event for node: 674070b711fb139cb87e2169
11/22/2024 01:34:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b711fb139cb87e2169
11/22/2024 01:34:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba9
11/22/2024 01:34:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bab
11/22/2024 01:34:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bad
11/22/2024 01:34:54 PM UTC [INFO] Received an event for node: 674070e311fb139cb87e2232
11/22/2024 01:36:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2d1796fcd6f4c9e60e7ebe1387780a5bacc1928c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070e311fb139cb87e2232', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f753f55e92f667a50848e098a531b126158600d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070e311fb139cb87e2232', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:60df3608a7b114d99fdb2b19f63480b0030734cd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c9ff36d164466ac08e814dbd6a22b9c242f3a58', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c5e59a42c292f2d0e30d66d5c866e67ed8671f5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:10d7cb9f0b28ee621f06bc17f15ea76f6a49488d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cffb5b51e980d95c1bd3cb3f97b5f502e86c116e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ffe5da21941756bb56f18174877a0a395afd77cc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:73cce866cbaf3eb38ec35733d442cba0be8ad372', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0ef071b3d837d707f820cade1c9a848afe00be75', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ae9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aa3d7128e4c6fe508cd1b92a164c72e7f74edd44', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7cd807345b1701500d80fd36f588ac80f58231d1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:19f45928633dea6448ae9980ef4f8ea24db042ec', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aeb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1557198c59ce5e152db5a2755b4653e4138f2e0c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aeb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c2a65ded795a6f81d085cfa0fcff3b4079ac3709', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8cbe71185c3d53adfe17b26c126e758fac5fa96', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:517cd5dbbf495c6d45413fbace7c6a5174d2b4fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2105322a4a588f480e9c7b2558636b28ca762ca9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aed', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bd2357bcf2f5c7fb9298c7711c1298f20b4d3dd5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ca983c69c063bda120a3a79f83a987608ad158c7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:534c342df7886e2aa10b0264443c68f9f43add00', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ee392ad95679e35aea2a58191c468727e903336e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aef', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ce1a065c9297da8d7e6271928d0c91922f5a61ad', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:267c30b730d32395522448f1d00781f0a44adace', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2512551eaa3a5e8f5490f6b4ed8c0c13449293f2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7ad5128e53df9f457c3fe5d0fc02a2a1f9aaf914', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8437dd688789804949d6918285f5d43bbdb05559', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:093fdd3b29709242afcbfd30c0676dbdc76ab642', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:069bd3d4a0939d09be3ddf421b032acce9dd2a20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:802569d4f9886cd56b670f4874771fc3335ef044', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:77ba53f3497d3762052be80e89092fd4ebf93193', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f5c4654660453cfb985d34930449662c929da74', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:80efa9599a92dedc0b92e3671648ed30b779cab5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:49446b8788030bbb1f294cd05976310977d20970', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4d6e0b641455a44c07235bca5e784122ab126ddb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57269506223967776961cdbd5a8aa9232af2b767', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:69cb0e4c3cd2b1b9dee77e2c318f7d8f15545cd7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:19979e6df5c958a39321cc0a2a1f6a092b103ab3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:14211e4312ed3b2d1c073a03c542f26dac72f67b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0271b22f2afb9cd0c2c9c22d7356abeda0cdeaa4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2dde1a3f1343b1a8795a383909f21f4929cbf6db', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f9c3bfefa5220d0a25bd29759537a4bb1aec677a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2af9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a55fefb3c89e710407bfea7facedecaa8b4cdbc5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fbab3e02b045791da2d6a67722bd02ee62abad8b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:36:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d2979589764f17f6ad269c05c9063ead51905ed0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:870fb64bcfd856ac6d06dd94cd40a217687c34d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dd4a76a8fa24f586b04ae3154079e0dd369ad096', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8d938284dbc1128d3832f1d26aec5c7bfe254a4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8ed5cafe55328ed3d4c2470be52786fc5d01d301', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5c3fdd1bde4ef00c1d4e1d03ea07e5c0595431d1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f8bf64170ef60c9897aca9b695729c2fbc7a78a5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:814cd02af633145ecbd6c48c67b19f7d1eb159a7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2afe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7eb98b986ecb201fedc3c632ff40ee92680d5907', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b63b3d98917b7080198a99708b2107fd60c2e2f8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2aff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:43e53287f5da8fa08db04ed0261e83ec2580618f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6aecb1260d4fdc1b871a034dab9b187268272789', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d95966cccd2b8ab20cb3fbb250bc1eac549f9407', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ae9eadbe32bfc8496ae330f68285aa6be0756e53', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a252e56a46e896dc5afb217a9b3c3d7762d5c5fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7734f81b71bff7e0b9fd42ebf11c99e75bf6f925', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8433c7c4e9f5c6d7d8a12f6b6f7720b06ac5d37c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d90713e6fbe0449f40cd6525791944e5b40db361', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d36900dfd74335c293680a45db4ae8afbef3d96', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0585db3c90f111526359d968becd54846d1b848c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3094f794feee167d6ef0febbdf0f8a30ffd64918', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3b9984104e5251797e22a98056ba777b01f91d49', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5615ab2afce7eb787bb29f032a608d0e33e74bc2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d5d81278730ed445f05231613e92537cfe9c08b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:951963bf8537298baa4d5d71065f20c91855cb72', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6d36b06514cfb473034763305be1afe123155b9e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f4bf9f00fa30c1697b353fe3717bdd32c210e690', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:49675fc8ca3ac44b18fd8f59f763a17b7ea72b02', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b48c47dbfbc3dc4a04922153056fd83bff1996c9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e6eaa54db3136e1b63e59430d435eae218ffc017', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7743a5c10425233cf732b082ca22e7413f2d8e6d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:edb1c2ddfa95400960362bede5bc9782313f3efe', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3b6792d2d98bfbb73edc892a14e103aec1347f21', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1655773ec0cc4fc19ebda1547d2901d7bf40c0e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f154c2f18cc85e9f2ef2167fbd79674290387755', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c467ebb9c794dd52089679d631275d5188c3ff43', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dce18ccf2d02f5adcee4aee152f8bdf4978e7e2c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f0fd570a2039c29f8fa8c8893c98949ec728d151', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e336c67efa981fcd3ca8c88dccb33ae87acc6ae3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fabd461914539feccde9918e9ff8a1a71d9966f5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:71c4c59786de8ee1eb55bfe9629c7d79a9485c08', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c9049f4b3542ed1b44208dbe18e3befc0acf9767', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bba6f32dda6024487cd38d6fe11048fca2104e0d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47c62bff22766fe12de9aeceecde78ad408bcd36', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:17e79eed20ce1435856ae58aba4e63e75e198593', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:834393a26cab8cc76638a8538f74a5b1861b7ad7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7fa1cf2cc7a0df08c65ca83b332a641d9eb5df11', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8801d2d361c2748232adcc50b5842861a74a7647', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c602cd447eb96cd2250f07a02215547ef65de214', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f31a8ca14645a7d6035bf9042c3517456992278', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0467d192228bdd5b3cf3a10c01f6404f6ed75067', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:206be82eddc28fd48f842c0012c5288e404a258d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a2f9f05a5673fe7c79982ae52109bd1c1f8f8479', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:89e504c3ecb6dabe0f8baeb664f8f90f7f726fb7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e399f43cad4a9aded4e2a225c6eb6985b2abfbf0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:afe7a1824b8022b1cef0314e68e568f91ca803f2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fe353efd1bc0f99eb14801d13748730c6107c6f2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:85fad79053739ed2ee455496d57255dd336041ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a55dabd98d8bc6ea10924d3ea75a5dac66cd0f2c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:518bdf55c6027f5d6896c13fe7e1c2c8d0c67c7c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee2b38903d2d7800ef89ac5633767e7cd58bb0e9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bd823b9af40ee530feaaaba1c1464cc079be474e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5a767798a00c1c61a1ed8d97621fea7ff04ea896', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:830f696c03b9fedf5ac482f4a1219045aabde213', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1f3002a56d4ca1d673bc2d2de3f32a0c0765eb6f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0d713e280c6ad3c9cee02fcf2242930fa1f89810', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9ba3f0ac3f5249a9839c99e1d0cb8c1e2492ab83', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:92bc8d6e63343bf835f317e95d951bbfbae6d96c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ebe104d3f19c52c71c7fc618de5cf7817cac2873', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:017f76b00830b842567f386d190ee8c5414f0f0e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:48f83c118171c4caec4199aec69138dcaf58ce47', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:715d8171b72c4bdd5b100f66d9fe5650852f4236', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8813fb036a73352ad4bf0d705e2ae157699f484f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6cd7b09fd026fe8883376307b2620e1af8ba0579', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ff262b6365fdf6cb2e793a3373621af1620da970', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2af36235d6b80e77947222997dad21a2b1471ce5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:59c79d9d003ac929c0dc4827f2734b36a81b70b8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7764454940fb66d8272f7896b6de8da4e9dd005', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:414f06b34bd7d2c720e524432f4ad88f07a176d2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ffce6df49c6eef63f0a55c054ee7f50ec96ad683', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:93f0ee26312306ab1d262e178170b7bb8ea7ae66', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29865d6d1cf76abc04cf9d7ecc6da59cd228e8d3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a050052f662150f72bf35081ea525f6b1e900e25', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aeff613b9f0e7c4f02206913b7f3e47530f65c72', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4746e1c0b3810fbb296eee503757081d9df62e9c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cbd43388758cb322f275aa3bf615e71253e2d8ea', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b14468091be2a685796650335bed8831f10f21fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f7e14d5028f074ae1861f6950703e18eba35a445', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c0cc824860e375441fdd0220cb27fcb21d54bc7d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ff0a41846ef9410687d304d09a03862b02fd5527', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2a0fe6e3fd381578eb8a19104f4e45287ee199ec', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:36d5eb1065da1522d46009dc3969754339c1bea6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3549f21d72caa0250cbb501c2e1a059d735572af', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4128d4a8d95ecf820698b25f07f22e00d58b1b99', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:81b2e3dfbb15f717596716997aa58b09e692cc2e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:56b91bd5824db31c36b946720ca77ce02fd2744c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cd7e893528e0d3424bcb8cd5c1350f3b2be8c6b5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d1359b00b2f69fcafc6090c6924e5773f5b016d8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c7031af3b1ad1c44bcec53f4968350420589d0d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:638c9214f8f1ee33742e94398ca97e42b0fcef15', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4513cfb14c3845844bcbdb4a2b8c65adf3102e30', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c42aea276c5ca559044f81e08ca5e92da73572b9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:044b908909a17c9c18a6c4d37521fa8be5b30b19', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:02d757f1d3d017d699b3bf2aa674f3d4639e3e47', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f3b2567ce6d40c3d93187cb1cad6a8d15b48606f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ac5212f7de2f5aa299c8bd68f7be059c984e6da1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ca6031382bd8087e490338086e8780872d811158', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:755e52cddf270dd92d3f886283f8df901aec3b3e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8a1adbe46991d4648be1ce6990e449406cbed0b0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68221e29ffa1d9bd12efbb634aa3e281c8d1ec6a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:55ab23d12b3a4d8ceff8359f95fc2187d71d3243', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f7b6f59a98230fa101e60ecde81f8f4f15bb34d4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d3f40ea14c3488079fa154fef9eae6538026ee7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d1b72edca04049d91e31b3779d3413e4092b35d7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ce945fa655cc38ec0f9f2403412682a0cb574814', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:81189220d94315bc7ed00a5885cff3f3f5625617', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e22e1f5ac15c181d9f26af20de8cd8988865ca84', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:741acf4963d0ff26a5a07c14276aa78f42c71233', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4136b88bb3be07ec86daf8661efc35937e64e037', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ffd92e1fa2d55dff804f90e7eb68aab033265e85', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5f19e52a6db79cd0bd1576ecad0937bd80b3dc0e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a193bc27615cc8c83459128d0db7363d6a508807', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5b0c4d1110419f0dc81f28486dac6c52ba594dc8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c4668a1218757ae9b4bee0c432714fc69d315b83', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5ac96ebd4f92f5c2eda8bc63d0173580f5154982', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a22134c24ccecca09521e65c7c04d130c2a08625', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:eb5667d755a8b10512298018885220a5adf90957', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8d40cd3fae49b880eb8e29e8eb84bcac06b52114', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e65a18a0d8ac8bb01dc361e3f77ed24286a7daf5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d10b3b7a76d452d99d9741606143abbc758e9ffa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e50c37518b5ce2483bef3170ef08f44c11cdf608', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ea72fef3532df96058eb080a73652e1c9182c86c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f55a7d5fa4855669ce1c5cc5c2cc12d660e2698a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8bf8fda1b494d73a6e23f20e6b2e613574608726', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7716226c1add7f46583a1664f6befb87859f9539', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5ec0a6797ce75b2d66ce33b95c95164a32a80456', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:819aff32becd231d2b6b1d2b8feabbf8a086117d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7604e90da076122fa9a4755820d6d7c5150bb59f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d528626e764b9bece0d51b32f41aea9687720db3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8ceaafd8c112a2ba8cdecdcf5063661df4485ba0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8980621d4b1710578cdacf19771d04b9df66d231', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7f0e12d8e5501981b819d6dc7e7bc4323f021d8d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f4169127a01d9bfaf124cb0e5ec9e73dfb5d7c4a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a02428a143b22ed59de866273342090fc616b797', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3df75826f867734018a84ce338850d166bc28616', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b6c0ee1b507f0d274fef95b6704e48757933e555', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f5a039f82b3af6328136778fe2e5cbf4d7b422f5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e81b4a776a4426cca96cc686afea0cf0f82e9a91', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:61064f7e34b138c286419ca5f913ec8a2ae8e419', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4c29e64bd75811c617eafc256da8ba7788969242', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a7e75c42f6378df9455ca257944896849a8cbf87', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c7c20828108527eed4d8a1bfdbeb1689930366ab', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9d97e9479701bebc08aec25819c4ac0aa39eb4c1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:352a2dbd5dc36423bd4ea13420383bba168be594', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ab41bcb31ae94c41808493a78d14f423a7d12201', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b527dc3b91df7587d865f1e1b8eea7b6045fad3a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d25ccf9665257bd2150263abeae1ce93c879f989', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6f3e8300d1ca4ab982a452bfd6260b827330943b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b1e7e650198bd160965457978d1efa66be8c1e6f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eab9c3a9b251c79529a25b6df3e97308ef44a642', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a4eb771e1e2871b67617bd8c45449579278e50be', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0782b8fed0203b6bd489159bd4cb22b7610f5502', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:74f37f71781513ce4bef130edcc295efc8fc1a8f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3dcad7f8272e7575172af0ad5088044ae8756f9b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cb85fa941b9989b5ee9f42eabc398a8d90a7157f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f3f18346a8bf07fc64adbddfc3ef2c9962f65e2e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e28b7e38259da2c2ede68107f5f04cfe99ef7723', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:efdf173d1da79fbb9e1a308a0249a0bea64a9a72', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5ac818a0ade56c1708eeadcc2451c1d82098842e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8732b5ae007a5423f4eb2ccbbf6e71751e3ee46b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:758b34d2a288d04136cb78b9323c8f34e17048fb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:664bdefb1d146705ea0f8143250aca9b3171c010', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1f68a7172d0e32de189b48a5e599f1ed7767b69d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b7e86469d218374973a5ed0a87148b02efad157', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3850dd4bca7a87f7dc5b8322e45c0f21cc1c5eb1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18aaa4146528353c3cd805d02b009fb00a96895e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9189a998db4dfe0d2f00c5535fd29ede491cc0bb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f28415202d2968379733230e801e4c53ba24bad', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2bf2f55eeb77e0ae7de8151ecddbdc191e8c34af', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:69f89f9f2f04d42eec737f33dee83952826770d6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:78fb24c6398f219c1f7588faefb9162524ce8286', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e498a4b1a55ef4478bf6282d41d5bc66e2c29298', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1a92745be74630ba91fbcd37f6b851961ec2eb68', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34c683d593d6ed8ea31977f4b43b4391298a1f0c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7bfbba6115bdaf2e9f9892c481cff1c5557ea85e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e8113e9869aaacb18373a959cd69d906b75e406a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cd062616b261c8c78ee5a6c2c4826c1c57b81866', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e684b404e76e4381e3d0fcab370e52fe0e620b83', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:08312f9b328ba18fea4380ecd5c75f05aaa63bb1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:23b99e60c9266dc04445cf15fcf3617c2cdd5ca7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:50be9454e808c405ec193d1448957ba6b73aa6fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9f8c9dff2b07c443707c7159c1e0561ec07211ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ebc3c23a67da7b90160a860dd55673c33d868020', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1ce0ba3ac8f53ce779847d56606a2529df454ba', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2763e57c1df56f5b8c674536bf3b9265a4c99464', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eaf9b3e77473b2cfb24138a20af65a5f8f997fb1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1e28e53b9a22d47966afa51b92c3cbe664279f4b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ce0fea05b0c53afe01722dfe4e646adf0a4c17ab', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2e3fe4ad08c6992138c663d7e5be97fa4c43ae64', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:32df593a934a3ed0fd78f04557bc0a386b19f184', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cde36ed3e001179f1a5a1d1cbfa8453b7045ca1a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:eb59fcafbf80694591b65fbda5a056e0ef43448c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9e04200cdeb2eab3c82f71ff472af4b0409c378b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:daccd2b81c735713c8cf1a6290a4088888bb238a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0beeb7825ad1e731c2ae000b566756b9a48b00ac', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:434b52633bb227cc84c73b296821c164983c7bf4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:25a6a7502d1436a0984fb44482d616e814bad83e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:08e069f17c83ceeec1731fdc9e332d615d9e5109', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:86538853c93b53375cc3aade2ebb67ff14fd6994', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a9711e5e14cb33d5a663a80a571059b3bb16eb70', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:38c07ec8d911d7a8c704506fbdf948ea42ae7a45', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:db71ae7cca7172b836f065752d3a3b7a6b5532b3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:812e2d8b09f9c2540d08cb82ce512ba04aa0096a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d7ccedbdd3e497fa2672f731937739c8e0b1c90b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:83fb740e8eb5c68948adfd96776d19a5b04455cf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:133643419cc7a0e191fbfd1d8f9b3d2865656725', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:10cbbb85cd70862e0c3bf91bee8644ccef6144fb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1d4df25c5f0df75f231b5d5853d34c4e1ef26aeb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7968ccab01d57a0e07f0cd29f03bfb533c9ad813', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:33b3816441c2c79cafd98890435387f724539a56', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:067c46746d327fd1b41052bfdc5ec938aca85af7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:60b9260bae6e3343820bbc79d830f9cf508280b5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b800228250787579d592e12ce64e5b8fb345b3f1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a55d80007a81573eab3e2dbf3d7a58223fa5126', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f491fcce51b3357d1abcd1213ae9a604062a1d2f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4611fd57f37d1dd24344392cdf9bf06d1b555899', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:59ca3c393a622e2b2be6ef3397710cc698b6e8dd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d913f6d5ff8985f08cf8ff3d0085c8dfb880f5e7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:50bbb51457e6e41763f7a0ea8d521034830ea553', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:107a22f335397e834c2e49d606b1683c2fd83787', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f401d29431979bfe44b6fb9df9ed238fc795a9f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f49b384a6c4a6584a761e7e5ba6380a2b8ee20d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:317e3b9658e75820119c98835f761aef1505e8ae', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0f76262e6a2b4acee96b5dbf93267ea56a0b5537', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8cb35ad5b43ab4164bbd00601d525283f93891f8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8c1d74ad37df2ab2e48ea582f6c65116af2cffef', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6ade7e591b559014be8733befcdc4c12b4aece23', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f1d29fba96858db6b0efdde82c290f2c6856385c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:567248b907648730cdfc5346fec3aad74ecbb680', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:61982ea770177fa2bf5ff7b3e57b86513f5b1bc3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d36aa8c0effe3aad54a5815de823beefc9284a7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f34e87230b906e572aa3d99bd48824f260707e4e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:41169c4daf24a8b7570c714a772ef456bb1acecc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8cfb34ecc8012248f64ce710e5b0efd1a71ed464', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c48234082c903730f0d1aab43f9918be77936906', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8738b1afafed2b027617a0f58abdd065fbeb6453', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6651d535bd263eb3fa6cd4adbb2744a73971f122', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8518bf122919c1e9d04024d5f7d944d32be091cc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c76230aa652dadc7b5bfefae3e8bd99481644abb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4fec17c1ad4679d195506409aa4c34faae1e384f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7461ca23a87c02a240dec074b63874f2093172e9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7d310baee96c12b0ca29da274e82d064e83d3d69', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7a19a03a7fd8f638ce49503d119f617a5df34db8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:22880c22bb2a917c41d2e9adacc74eeffbd8398c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:60748b4d2b965c72b1e069483ff8a73acd1b9922', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6c68103de6bccc11ab4a00fdeaf0bb836653b4ef', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ed7e63852f5d1431d61334bf3bbe0359145d816d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:86328d13ad9c8567ddf35c2cbd618a3ef26153cf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9cd9ff79486ec12372425e837bf39f993101b68a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30f85f5c55a2f4252d48f9c89e80b87c0cfeb6c2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d6c1c98e4040cd771b72848adbf09e56db547b1c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f4ec49b169adfa68cf9bfc04273ddde20c2184d2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e35bdeb2f4977454dcc5300100f3f412fe52f726', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4df75fb53c0659fa48968d6dff2f5ffd4404f735', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cbcd8a8b7b5c0649cbe3de81eb77b9cc2ba0ca15', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3d2d57a254d830acf9578342eff2163949fa48fa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4b5df1ddafdae349c61a245c86d2d3f47b66866f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:30399240999c95da0159905ca1002402ccb413d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f82ee0e07ddf99c77f9dc0ec8bd9da94c9e63460', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:45f25bfe1cfbc0f8a697fb754f8aa64bec9f6fce', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dfff8190a4b94d7879520abeed17bb8f7e8282c9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bb0b9c7e84d2a3f8101188ffce345f8e8cd9ba71', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fba8ee5881a8f848b32c5de2fd83d796cdcecddf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:789c508c412118fb4cc7943cf0c90757451fee7d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:64a82fbc601dedaf6c297468478c5df7cd81adbc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:215334d595ad29d03eab86c4b387c82964a5b214', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:369f876e4d5eebcb5ca3364d80e1358514e8f5fc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:89effe4c72eb9fe5b9eb6ac7b21543b69906749b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:779cf7a5535fc89c54ed1e6e59f314bb8e37405a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ea567090bfb563665e7d77ea6d076b95db8a7f65', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d671a7fdb2c2dca9cad9d4b3d6eeb62d32183aa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d677bb1c8cdfa7883129063de8ebf37a38b808c3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3b25783e2b695cd496c8fd62da19f00cadb19548', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:339ef00e487ef150564e5d38a33c82195a7f3d52', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2443d0bf918f33ed90358e174b851adbd98a75d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:da055bea8b4a60a68a13ec7893acf358e8acc377', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:870043dfd516213ff8e9e82d4b6ba89a6aa11748', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c390b657e9ec125ca3126b1eec37125edfb7aaf7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7084640a95f58e9289dfe5052d81604f662246a8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c7786c575e8bc5085fc0d1fdc7bec9dcb0bb94de', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9506b876a04ede3f1dfd1bdd87fefe15df6c8a18', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1532a23ae4ad76389b323a30a9b46221f5e974a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1811866e7886699624cc1d681862028cd2aa32f8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f9c1701094476748f0825c64c807ecbf4b85ca69', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:70f0ee5642bb3f4aa20c301b1ac310191e3c9ccc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b614078dd17034689f612642ddf3376c24756b18', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee94cf48db6e6fdc06a9daa90a7f09e18ba96c57', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c03c7f62d4049b13a6a567ef23eadf1196450359', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ed7e8dd9ac7e3a64fd2f986cc7715618ecc6d4fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab2bc9e81775580618cf0e40d148df874bd5bd61', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b93be983267ca1def458eb197acf94add057da7e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:08ed2444c7a71f9f0f88e31943449b865754d931', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:278c1aa00b43f9159ff6ae300da3d53c4b1014b2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a8b2be7399b7fb0f40d277cc6287c88071d66da', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:493f919f0f2ea0a2ee9699497d44e749a9a91d58', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f50f276555edf36209c7bfcb5889d1aa2542e7a7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e622033437b9c2d3a93756e987579fb7bbbf9b5b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d0e24a58c056e37aa94208947f43a826c65eb774', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54b4397f9370644de20b913310f1d7bb7e423e6d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fcff2e88e5352d296b99073d88a36f7fb5e3b86c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e045eff14a90c5b92ff1e3d65845ad923b279984', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:00bb6248e41b52ca1356716512f1773a76e60155', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b1aa939183f4e5998edf2567b9a78dd7066b9dd4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:307dec834ba1f86fd0fbfbd41c27ee02f472db1e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:eb4fbde455e92dc620d81aa5ce351d40ddfc891e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f85b75fd78403cbb858b16ea49348337f0ebcda7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:27ffa62c36353b706452be74aec6fa89898040de', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a6a0de610c343216fe9c5dadce213efdce9bcc3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:09f442662946027e0a426c78990eae5fe3c88e61', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c79b955cc6c701e2431e4cfe30681cf9c6d56474', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7755cd2c21308449f33a8e9fb08b9f732a16b50e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e58ac90357d6454f89f79422ae5bf416871939b4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:37:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2279c57b2d0782b64fd4195c4249387b0333b0d0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6eaa47b32b1b906c16f82d7e015d278727f3a504', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:04fc8015742da44051148c0d7bc51384c9e55a6f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd8c6decfa6750052036912954f8f8da682c72d5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9f018695990328a7b2eda2077765b7919393906a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cd21b5a2ed0716e81d4774b833c5dd2b3c00bb72', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:87a53b7bfbf9e8b56bc4b9189a6905fdac0476e8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3d461c2bef86b0e1e37df3f935886508e103e9ec', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2b9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ba8019f3ca0b7e10636f488d3c5c627bf5a4a466', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:638a654de12947e6a72e8db469f89d6b44d8925e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:16e1a41079ae86aa658de1dec6a6931488ab5c17', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:847bf5bfdfc5f1ea170656c7de76e3029922cc22', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:28fad07532f0707627271e9f8b1b965cf3e51dbe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be80c64cde64b472f096f21527073ea0f2945f33', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:48456d2f83ea8a0c49b75202b90c2c28346118d2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cfb59a9e9665ea80002428b55a2642c9c7bd0f83', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:92a6e346a58f272ab0254f52f7a87722ae4150e1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8f485f5d20933cf4b541d40f2e502c0df977baf8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4519dad46ba252f6d55f4f389e8b5e7795219ecd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b18397202823786c49ff62805c47529bdf14d2ec', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d0958bf08a0dd96fafffa5ac6bf725c0ef283998', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c79b7a0710564c1853af4bdb9f8bc83e067c72a1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1d6f86ff6ac118c17a31ecffc1400cc623d67c8b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b52f77addf62b63f9224a5080a0aeded85ab19d2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2ba8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8f2281e3b030026da14722233deeadf78f8c16a0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2baa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:071ea021a987ee79065b0943e9c2b1366419492a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2baa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2f25b82c512a96e2bdd64324b1bbda9c6b9bc1d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b022807790de1f63c2f3fa3157cef52430c8e8ca', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8b565428910e94e8ef00cfaae4236e3ea9036cb7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9bafdcf24c9edd64152f0fd918e7741900ea25f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6c5238403c20351e16513550996fbbfd9b998371', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8083376614dafa70ef61066190bc62cd0d5e4f37', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f23de34fd9670631a5dc4ba5c2cd52021d9abf79', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b023880c0ccbce9697300c572040d43b7a1b8b4b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b95fcb6f4dedc21402fb7c2b122759151420dba0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:08925ff92b62a2d45124d68d61946381134fd483', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cad9c83ab2bfad9553c3b1f92a23ef054fe76e33', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd2716d0721004e0ec2681686c4ac838e9295a5d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c1791938fc9a2d55ef44c93065f9533baca853e9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a406a721148434004678399fec0bdaa9072f4a5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bb0aa0a830694436ad265ee80dc1f09dcff04530', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2b05cdec22503129a66131f794d99c4add73f834', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d588d1deafcbdbe47e39c3e8b7e746b8b2320882', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:de78cf1cf0f76c9d20456adbc809a1c538081e67', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bb9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e685ed026ab139792fe734aa02f10ef08782536d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9fb849eeb169196ae16adbb79ccbf558f8db0719', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bba', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ec6279bc51114bb5f6e83a17e7ac58b1c0b6c163', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5954740c652fdee2a497582bf8ffbd0c0e95e914', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fdc158acb5924894e54389ab1cd91becb17756d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:28f0c63bcd9389fd5318df15f14a526835490aa1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e3955797375e108e34a36fc3c32c585236fde591', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa397b7bab96b2254a55041ddb0119492897c17e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f5ea10800c68cd2f12e4c40b6d0e63229c3b9d02', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ae92511a5e94ae5f3ae0b1285f78fcb6e854523', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:403b0d2c7abae739b4147885818c14731c0aaa44', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3b512aba418a4f83b9d3abdb9c16fb6b9354f5fb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bbf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a26b5ed4d2d592c80c0e06ecff56978f53952de9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c3aa7ec40b8b00cc6d3c1399b1a82b8a79de936', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:58f2c60b0969850bb62b8900ab183a8f12df6496', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0deaad931795535b43e049baa20ad99ca630cd26', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e8fabf9cfba4655ab76dc5312de56deb56ebcff9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ec24af6cc1a53c0d7d36a495e25cc2d60f041d5b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:29b2bbe80d6107be0d66187f9267866713ad9aa7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:164f25cd200c1d73916c0732352998422dceb91c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:822045167a6cf6c2b2962fe318e76e7aaf60113f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:00f869a2aab8f1d65a83202046773c7ff41cad87', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1c5c81c0ea187e6bbc929575a5101726e6474c99', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:95e25396f17ed804df0821ea700b3ebaac5c0fc1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a62b0522e242df65de3c314003577c1812331da3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e1875b585a9581a6ef0922566f659c7c8e273e56', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:20ad4e230fb62ca1cf17975107f8ff31ead0761b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:26f4252d121324bcee9fa38c003e3d8ebf25568c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740732411fb139cb87e2bc7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e311fb139cb87e2232
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2add
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ade
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2adf
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ae9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aea
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aeb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aec
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aed
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aee
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aef
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2af9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2afa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2afb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2afc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2afd
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2afe
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2aff
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b00
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b01
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b02
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b03
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b04
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b05
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b06
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b07
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b08
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b09
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b0f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b10
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b11
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b12
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b13
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b14
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b15
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b16
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b17
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b18
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b19
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b1f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b20
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b21
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b22
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b23
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b24
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b25
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b26
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b27
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b28
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b29
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b2f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b30
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b31
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b32
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b33
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b34
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b35
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b36
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b37
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b38
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b39
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b3f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b40
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b41
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b42
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b43
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b44
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b45
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b46
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b47
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b48
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b49
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b4f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b50
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b51
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b52
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b53
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b54
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b55
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b56
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b57
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b58
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b59
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b5f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b60
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b61
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b62
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b63
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b64
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b65
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b66
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b67
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b68
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b69
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b6f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b70
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b71
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b72
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b73
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b74
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b75
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b76
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b77
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b78
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b79
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b7f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b80
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b81
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b82
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b83
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b84
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b85
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b86
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b87
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b88
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b89
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b8f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b90
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b91
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b92
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b93
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b94
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b95
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b96
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b97
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b98
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b99
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2b9f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2ba8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2baa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bac
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bae
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bb9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bba
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bbb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bbc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bbd
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bbe
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bbf
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740732411fb139cb87e2bc8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d1796fcd6f4c9e60e7ebe1387780a5bacc1928c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f753f55e92f667a50848e098a531b126158600d9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60df3608a7b114d99fdb2b19f63480b0030734cd
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c9ff36d164466ac08e814dbd6a22b9c242f3a58
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c5e59a42c292f2d0e30d66d5c866e67ed8671f5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10d7cb9f0b28ee621f06bc17f15ea76f6a49488d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cffb5b51e980d95c1bd3cb3f97b5f502e86c116e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ffe5da21941756bb56f18174877a0a395afd77cc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73cce866cbaf3eb38ec35733d442cba0be8ad372
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ef071b3d837d707f820cade1c9a848afe00be75
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa3d7128e4c6fe508cd1b92a164c72e7f74edd44
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cd807345b1701500d80fd36f588ac80f58231d1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19f45928633dea6448ae9980ef4f8ea24db042ec
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1557198c59ce5e152db5a2755b4653e4138f2e0c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2a65ded795a6f81d085cfa0fcff3b4079ac3709
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8cbe71185c3d53adfe17b26c126e758fac5fa96
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:517cd5dbbf495c6d45413fbace7c6a5174d2b4fa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2105322a4a588f480e9c7b2558636b28ca762ca9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd2357bcf2f5c7fb9298c7711c1298f20b4d3dd5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca983c69c063bda120a3a79f83a987608ad158c7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:534c342df7886e2aa10b0264443c68f9f43add00
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee392ad95679e35aea2a58191c468727e903336e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce1a065c9297da8d7e6271928d0c91922f5a61ad
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:267c30b730d32395522448f1d00781f0a44adace
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2512551eaa3a5e8f5490f6b4ed8c0c13449293f2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ad5128e53df9f457c3fe5d0fc02a2a1f9aaf914
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8437dd688789804949d6918285f5d43bbdb05559
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:093fdd3b29709242afcbfd30c0676dbdc76ab642
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:069bd3d4a0939d09be3ddf421b032acce9dd2a20
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:802569d4f9886cd56b670f4874771fc3335ef044
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:77ba53f3497d3762052be80e89092fd4ebf93193
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f5c4654660453cfb985d34930449662c929da74
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:80efa9599a92dedc0b92e3671648ed30b779cab5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:49446b8788030bbb1f294cd05976310977d20970
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d6e0b641455a44c07235bca5e784122ab126ddb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57269506223967776961cdbd5a8aa9232af2b767
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69cb0e4c3cd2b1b9dee77e2c318f7d8f15545cd7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19979e6df5c958a39321cc0a2a1f6a092b103ab3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:14211e4312ed3b2d1c073a03c542f26dac72f67b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0271b22f2afb9cd0c2c9c22d7356abeda0cdeaa4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2dde1a3f1343b1a8795a383909f21f4929cbf6db
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9c3bfefa5220d0a25bd29759537a4bb1aec677a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a55fefb3c89e710407bfea7facedecaa8b4cdbc5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fbab3e02b045791da2d6a67722bd02ee62abad8b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d2979589764f17f6ad269c05c9063ead51905ed0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:870fb64bcfd856ac6d06dd94cd40a217687c34d9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd4a76a8fa24f586b04ae3154079e0dd369ad096
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8d938284dbc1128d3832f1d26aec5c7bfe254a4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ed5cafe55328ed3d4c2470be52786fc5d01d301
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c3fdd1bde4ef00c1d4e1d03ea07e5c0595431d1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8bf64170ef60c9897aca9b695729c2fbc7a78a5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:814cd02af633145ecbd6c48c67b19f7d1eb159a7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7eb98b986ecb201fedc3c632ff40ee92680d5907
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b63b3d98917b7080198a99708b2107fd60c2e2f8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:43e53287f5da8fa08db04ed0261e83ec2580618f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6aecb1260d4fdc1b871a034dab9b187268272789
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d95966cccd2b8ab20cb3fbb250bc1eac549f9407
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ae9eadbe32bfc8496ae330f68285aa6be0756e53
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a252e56a46e896dc5afb217a9b3c3d7762d5c5fa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7734f81b71bff7e0b9fd42ebf11c99e75bf6f925
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8433c7c4e9f5c6d7d8a12f6b6f7720b06ac5d37c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d90713e6fbe0449f40cd6525791944e5b40db361
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d36900dfd74335c293680a45db4ae8afbef3d96
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0585db3c90f111526359d968becd54846d1b848c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3094f794feee167d6ef0febbdf0f8a30ffd64918
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b9984104e5251797e22a98056ba777b01f91d49
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5615ab2afce7eb787bb29f032a608d0e33e74bc2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d5d81278730ed445f05231613e92537cfe9c08b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:951963bf8537298baa4d5d71065f20c91855cb72
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6d36b06514cfb473034763305be1afe123155b9e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4bf9f00fa30c1697b353fe3717bdd32c210e690
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:49675fc8ca3ac44b18fd8f59f763a17b7ea72b02
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b48c47dbfbc3dc4a04922153056fd83bff1996c9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e6eaa54db3136e1b63e59430d435eae218ffc017
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7743a5c10425233cf732b082ca22e7413f2d8e6d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:edb1c2ddfa95400960362bede5bc9782313f3efe
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b6792d2d98bfbb73edc892a14e103aec1347f21
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1655773ec0cc4fc19ebda1547d2901d7bf40c0e2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f154c2f18cc85e9f2ef2167fbd79674290387755
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c467ebb9c794dd52089679d631275d5188c3ff43
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dce18ccf2d02f5adcee4aee152f8bdf4978e7e2c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f0fd570a2039c29f8fa8c8893c98949ec728d151
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e336c67efa981fcd3ca8c88dccb33ae87acc6ae3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fabd461914539feccde9918e9ff8a1a71d9966f5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71c4c59786de8ee1eb55bfe9629c7d79a9485c08
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9049f4b3542ed1b44208dbe18e3befc0acf9767
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bba6f32dda6024487cd38d6fe11048fca2104e0d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47c62bff22766fe12de9aeceecde78ad408bcd36
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:17e79eed20ce1435856ae58aba4e63e75e198593
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:834393a26cab8cc76638a8538f74a5b1861b7ad7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fa1cf2cc7a0df08c65ca83b332a641d9eb5df11
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8801d2d361c2748232adcc50b5842861a74a7647
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c602cd447eb96cd2250f07a02215547ef65de214
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f31a8ca14645a7d6035bf9042c3517456992278
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0467d192228bdd5b3cf3a10c01f6404f6ed75067
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:206be82eddc28fd48f842c0012c5288e404a258d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a2f9f05a5673fe7c79982ae52109bd1c1f8f8479
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89e504c3ecb6dabe0f8baeb664f8f90f7f726fb7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e399f43cad4a9aded4e2a225c6eb6985b2abfbf0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:afe7a1824b8022b1cef0314e68e568f91ca803f2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe353efd1bc0f99eb14801d13748730c6107c6f2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:85fad79053739ed2ee455496d57255dd336041ff
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a55dabd98d8bc6ea10924d3ea75a5dac66cd0f2c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:518bdf55c6027f5d6896c13fe7e1c2c8d0c67c7c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee2b38903d2d7800ef89ac5633767e7cd58bb0e9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd823b9af40ee530feaaaba1c1464cc079be474e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a767798a00c1c61a1ed8d97621fea7ff04ea896
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:830f696c03b9fedf5ac482f4a1219045aabde213
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f3002a56d4ca1d673bc2d2de3f32a0c0765eb6f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d713e280c6ad3c9cee02fcf2242930fa1f89810
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9ba3f0ac3f5249a9839c99e1d0cb8c1e2492ab83
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92bc8d6e63343bf835f317e95d951bbfbae6d96c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebe104d3f19c52c71c7fc618de5cf7817cac2873
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:017f76b00830b842567f386d190ee8c5414f0f0e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48f83c118171c4caec4199aec69138dcaf58ce47
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:715d8171b72c4bdd5b100f66d9fe5650852f4236
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8813fb036a73352ad4bf0d705e2ae157699f484f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6cd7b09fd026fe8883376307b2620e1af8ba0579
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff262b6365fdf6cb2e793a3373621af1620da970
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2af36235d6b80e77947222997dad21a2b1471ce5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59c79d9d003ac929c0dc4827f2734b36a81b70b8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7764454940fb66d8272f7896b6de8da4e9dd005
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:414f06b34bd7d2c720e524432f4ad88f07a176d2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ffce6df49c6eef63f0a55c054ee7f50ec96ad683
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93f0ee26312306ab1d262e178170b7bb8ea7ae66
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29865d6d1cf76abc04cf9d7ecc6da59cd228e8d3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a050052f662150f72bf35081ea525f6b1e900e25
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aeff613b9f0e7c4f02206913b7f3e47530f65c72
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4746e1c0b3810fbb296eee503757081d9df62e9c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbd43388758cb322f275aa3bf615e71253e2d8ea
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b14468091be2a685796650335bed8831f10f21fe
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7e14d5028f074ae1861f6950703e18eba35a445
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0cc824860e375441fdd0220cb27fcb21d54bc7d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ff0a41846ef9410687d304d09a03862b02fd5527
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a0fe6e3fd381578eb8a19104f4e45287ee199ec
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36d5eb1065da1522d46009dc3969754339c1bea6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3549f21d72caa0250cbb501c2e1a059d735572af
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4128d4a8d95ecf820698b25f07f22e00d58b1b99
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81b2e3dfbb15f717596716997aa58b09e692cc2e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56b91bd5824db31c36b946720ca77ce02fd2744c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cd7e893528e0d3424bcb8cd5c1350f3b2be8c6b5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1359b00b2f69fcafc6090c6924e5773f5b016d8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c7031af3b1ad1c44bcec53f4968350420589d0d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:638c9214f8f1ee33742e94398ca97e42b0fcef15
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4513cfb14c3845844bcbdb4a2b8c65adf3102e30
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c42aea276c5ca559044f81e08ca5e92da73572b9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:044b908909a17c9c18a6c4d37521fa8be5b30b19
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:02d757f1d3d017d699b3bf2aa674f3d4639e3e47
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f3b2567ce6d40c3d93187cb1cad6a8d15b48606f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac5212f7de2f5aa299c8bd68f7be059c984e6da1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ca6031382bd8087e490338086e8780872d811158
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:755e52cddf270dd92d3f886283f8df901aec3b3e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a1adbe46991d4648be1ce6990e449406cbed0b0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68221e29ffa1d9bd12efbb634aa3e281c8d1ec6a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55ab23d12b3a4d8ceff8359f95fc2187d71d3243
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7b6f59a98230fa101e60ecde81f8f4f15bb34d4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d3f40ea14c3488079fa154fef9eae6538026ee7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1b72edca04049d91e31b3779d3413e4092b35d7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce945fa655cc38ec0f9f2403412682a0cb574814
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:81189220d94315bc7ed00a5885cff3f3f5625617
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e22e1f5ac15c181d9f26af20de8cd8988865ca84
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:741acf4963d0ff26a5a07c14276aa78f42c71233
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4136b88bb3be07ec86daf8661efc35937e64e037
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ffd92e1fa2d55dff804f90e7eb68aab033265e85
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f19e52a6db79cd0bd1576ecad0937bd80b3dc0e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a193bc27615cc8c83459128d0db7363d6a508807
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b0c4d1110419f0dc81f28486dac6c52ba594dc8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4668a1218757ae9b4bee0c432714fc69d315b83
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ac96ebd4f92f5c2eda8bc63d0173580f5154982
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a22134c24ccecca09521e65c7c04d130c2a08625
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb5667d755a8b10512298018885220a5adf90957
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d40cd3fae49b880eb8e29e8eb84bcac06b52114
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e65a18a0d8ac8bb01dc361e3f77ed24286a7daf5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d10b3b7a76d452d99d9741606143abbc758e9ffa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e50c37518b5ce2483bef3170ef08f44c11cdf608
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea72fef3532df96058eb080a73652e1c9182c86c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f55a7d5fa4855669ce1c5cc5c2cc12d660e2698a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8bf8fda1b494d73a6e23f20e6b2e613574608726
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7716226c1add7f46583a1664f6befb87859f9539
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ec0a6797ce75b2d66ce33b95c95164a32a80456
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:819aff32becd231d2b6b1d2b8feabbf8a086117d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7604e90da076122fa9a4755820d6d7c5150bb59f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d528626e764b9bece0d51b32f41aea9687720db3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ceaafd8c112a2ba8cdecdcf5063661df4485ba0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8980621d4b1710578cdacf19771d04b9df66d231
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f0e12d8e5501981b819d6dc7e7bc4323f021d8d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4169127a01d9bfaf124cb0e5ec9e73dfb5d7c4a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a02428a143b22ed59de866273342090fc616b797
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3df75826f867734018a84ce338850d166bc28616
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6c0ee1b507f0d274fef95b6704e48757933e555
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5a039f82b3af6328136778fe2e5cbf4d7b422f5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e81b4a776a4426cca96cc686afea0cf0f82e9a91
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:61064f7e34b138c286419ca5f913ec8a2ae8e419
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c29e64bd75811c617eafc256da8ba7788969242
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7e75c42f6378df9455ca257944896849a8cbf87
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7c20828108527eed4d8a1bfdbeb1689930366ab
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9d97e9479701bebc08aec25819c4ac0aa39eb4c1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:352a2dbd5dc36423bd4ea13420383bba168be594
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab41bcb31ae94c41808493a78d14f423a7d12201
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b527dc3b91df7587d865f1e1b8eea7b6045fad3a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d25ccf9665257bd2150263abeae1ce93c879f989
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6f3e8300d1ca4ab982a452bfd6260b827330943b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1e7e650198bd160965457978d1efa66be8c1e6f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eab9c3a9b251c79529a25b6df3e97308ef44a642
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4eb771e1e2871b67617bd8c45449579278e50be
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0782b8fed0203b6bd489159bd4cb22b7610f5502
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:74f37f71781513ce4bef130edcc295efc8fc1a8f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3dcad7f8272e7575172af0ad5088044ae8756f9b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cb85fa941b9989b5ee9f42eabc398a8d90a7157f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f3f18346a8bf07fc64adbddfc3ef2c9962f65e2e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e28b7e38259da2c2ede68107f5f04cfe99ef7723
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efdf173d1da79fbb9e1a308a0249a0bea64a9a72
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ac818a0ade56c1708eeadcc2451c1d82098842e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8732b5ae007a5423f4eb2ccbbf6e71751e3ee46b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:758b34d2a288d04136cb78b9323c8f34e17048fb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:664bdefb1d146705ea0f8143250aca9b3171c010
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1f68a7172d0e32de189b48a5e599f1ed7767b69d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b7e86469d218374973a5ed0a87148b02efad157
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3850dd4bca7a87f7dc5b8322e45c0f21cc1c5eb1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18aaa4146528353c3cd805d02b009fb00a96895e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9189a998db4dfe0d2f00c5535fd29ede491cc0bb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f28415202d2968379733230e801e4c53ba24bad
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2bf2f55eeb77e0ae7de8151ecddbdc191e8c34af
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:69f89f9f2f04d42eec737f33dee83952826770d6
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78fb24c6398f219c1f7588faefb9162524ce8286
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e498a4b1a55ef4478bf6282d41d5bc66e2c29298
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a92745be74630ba91fbcd37f6b851961ec2eb68
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34c683d593d6ed8ea31977f4b43b4391298a1f0c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7bfbba6115bdaf2e9f9892c481cff1c5557ea85e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8113e9869aaacb18373a959cd69d906b75e406a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cd062616b261c8c78ee5a6c2c4826c1c57b81866
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e684b404e76e4381e3d0fcab370e52fe0e620b83
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08312f9b328ba18fea4380ecd5c75f05aaa63bb1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23b99e60c9266dc04445cf15fcf3617c2cdd5ca7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:50be9454e808c405ec193d1448957ba6b73aa6fa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9f8c9dff2b07c443707c7159c1e0561ec07211ff
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebc3c23a67da7b90160a860dd55673c33d868020
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1ce0ba3ac8f53ce779847d56606a2529df454ba
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2763e57c1df56f5b8c674536bf3b9265a4c99464
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eaf9b3e77473b2cfb24138a20af65a5f8f997fb1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e28e53b9a22d47966afa51b92c3cbe664279f4b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce0fea05b0c53afe01722dfe4e646adf0a4c17ab
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2e3fe4ad08c6992138c663d7e5be97fa4c43ae64
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:32df593a934a3ed0fd78f04557bc0a386b19f184
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cde36ed3e001179f1a5a1d1cbfa8453b7045ca1a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb59fcafbf80694591b65fbda5a056e0ef43448c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9e04200cdeb2eab3c82f71ff472af4b0409c378b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:daccd2b81c735713c8cf1a6290a4088888bb238a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0beeb7825ad1e731c2ae000b566756b9a48b00ac
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:434b52633bb227cc84c73b296821c164983c7bf4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:25a6a7502d1436a0984fb44482d616e814bad83e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08e069f17c83ceeec1731fdc9e332d615d9e5109
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86538853c93b53375cc3aade2ebb67ff14fd6994
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a9711e5e14cb33d5a663a80a571059b3bb16eb70
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38c07ec8d911d7a8c704506fbdf948ea42ae7a45
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db71ae7cca7172b836f065752d3a3b7a6b5532b3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:812e2d8b09f9c2540d08cb82ce512ba04aa0096a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7ccedbdd3e497fa2672f731937739c8e0b1c90b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83fb740e8eb5c68948adfd96776d19a5b04455cf
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:133643419cc7a0e191fbfd1d8f9b3d2865656725
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:10cbbb85cd70862e0c3bf91bee8644ccef6144fb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d4df25c5f0df75f231b5d5853d34c4e1ef26aeb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7968ccab01d57a0e07f0cd29f03bfb533c9ad813
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33b3816441c2c79cafd98890435387f724539a56
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:067c46746d327fd1b41052bfdc5ec938aca85af7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60b9260bae6e3343820bbc79d830f9cf508280b5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b800228250787579d592e12ce64e5b8fb345b3f1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a55d80007a81573eab3e2dbf3d7a58223fa5126
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f491fcce51b3357d1abcd1213ae9a604062a1d2f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4611fd57f37d1dd24344392cdf9bf06d1b555899
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59ca3c393a622e2b2be6ef3397710cc698b6e8dd
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d913f6d5ff8985f08cf8ff3d0085c8dfb880f5e7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:50bbb51457e6e41763f7a0ea8d521034830ea553
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:107a22f335397e834c2e49d606b1683c2fd83787
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f401d29431979bfe44b6fb9df9ed238fc795a9f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f49b384a6c4a6584a761e7e5ba6380a2b8ee20d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:317e3b9658e75820119c98835f761aef1505e8ae
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0f76262e6a2b4acee96b5dbf93267ea56a0b5537
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8cb35ad5b43ab4164bbd00601d525283f93891f8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8c1d74ad37df2ab2e48ea582f6c65116af2cffef
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ade7e591b559014be8733befcdc4c12b4aece23
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1d29fba96858db6b0efdde82c290f2c6856385c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:567248b907648730cdfc5346fec3aad74ecbb680
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:61982ea770177fa2bf5ff7b3e57b86513f5b1bc3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d36aa8c0effe3aad54a5815de823beefc9284a7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f34e87230b906e572aa3d99bd48824f260707e4e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41169c4daf24a8b7570c714a772ef456bb1acecc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8cfb34ecc8012248f64ce710e5b0efd1a71ed464
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c48234082c903730f0d1aab43f9918be77936906
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8738b1afafed2b027617a0f58abdd065fbeb6453
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6651d535bd263eb3fa6cd4adbb2744a73971f122
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8518bf122919c1e9d04024d5f7d944d32be091cc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c76230aa652dadc7b5bfefae3e8bd99481644abb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4fec17c1ad4679d195506409aa4c34faae1e384f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7461ca23a87c02a240dec074b63874f2093172e9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d310baee96c12b0ca29da274e82d064e83d3d69
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a19a03a7fd8f638ce49503d119f617a5df34db8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:22880c22bb2a917c41d2e9adacc74eeffbd8398c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:60748b4d2b965c72b1e069483ff8a73acd1b9922
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c68103de6bccc11ab4a00fdeaf0bb836653b4ef
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed7e63852f5d1431d61334bf3bbe0359145d816d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86328d13ad9c8567ddf35c2cbd618a3ef26153cf
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9cd9ff79486ec12372425e837bf39f993101b68a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30f85f5c55a2f4252d48f9c89e80b87c0cfeb6c2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d6c1c98e4040cd771b72848adbf09e56db547b1c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f4ec49b169adfa68cf9bfc04273ddde20c2184d2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e35bdeb2f4977454dcc5300100f3f412fe52f726
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4df75fb53c0659fa48968d6dff2f5ffd4404f735
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbcd8a8b7b5c0649cbe3de81eb77b9cc2ba0ca15
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d2d57a254d830acf9578342eff2163949fa48fa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b5df1ddafdae349c61a245c86d2d3f47b66866f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30399240999c95da0159905ca1002402ccb413d9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f82ee0e07ddf99c77f9dc0ec8bd9da94c9e63460
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45f25bfe1cfbc0f8a697fb754f8aa64bec9f6fce
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dfff8190a4b94d7879520abeed17bb8f7e8282c9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb0b9c7e84d2a3f8101188ffce345f8e8cd9ba71
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fba8ee5881a8f848b32c5de2fd83d796cdcecddf
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:789c508c412118fb4cc7943cf0c90757451fee7d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64a82fbc601dedaf6c297468478c5df7cd81adbc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:215334d595ad29d03eab86c4b387c82964a5b214
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:369f876e4d5eebcb5ca3364d80e1358514e8f5fc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:89effe4c72eb9fe5b9eb6ac7b21543b69906749b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:779cf7a5535fc89c54ed1e6e59f314bb8e37405a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ea567090bfb563665e7d77ea6d076b95db8a7f65
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d671a7fdb2c2dca9cad9d4b3d6eeb62d32183aa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d677bb1c8cdfa7883129063de8ebf37a38b808c3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b25783e2b695cd496c8fd62da19f00cadb19548
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:339ef00e487ef150564e5d38a33c82195a7f3d52
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2443d0bf918f33ed90358e174b851adbd98a75d5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:da055bea8b4a60a68a13ec7893acf358e8acc377
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:870043dfd516213ff8e9e82d4b6ba89a6aa11748
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c390b657e9ec125ca3126b1eec37125edfb7aaf7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7084640a95f58e9289dfe5052d81604f662246a8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c7786c575e8bc5085fc0d1fdc7bec9dcb0bb94de
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9506b876a04ede3f1dfd1bdd87fefe15df6c8a18
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1532a23ae4ad76389b323a30a9b46221f5e974a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1811866e7886699624cc1d681862028cd2aa32f8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f9c1701094476748f0825c64c807ecbf4b85ca69
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70f0ee5642bb3f4aa20c301b1ac310191e3c9ccc
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b614078dd17034689f612642ddf3376c24756b18
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee94cf48db6e6fdc06a9daa90a7f09e18ba96c57
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c03c7f62d4049b13a6a567ef23eadf1196450359
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed7e8dd9ac7e3a64fd2f986cc7715618ecc6d4fa
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab2bc9e81775580618cf0e40d148df874bd5bd61
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b93be983267ca1def458eb197acf94add057da7e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08ed2444c7a71f9f0f88e31943449b865754d931
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:278c1aa00b43f9159ff6ae300da3d53c4b1014b2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a8b2be7399b7fb0f40d277cc6287c88071d66da
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:493f919f0f2ea0a2ee9699497d44e749a9a91d58
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f50f276555edf36209c7bfcb5889d1aa2542e7a7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e622033437b9c2d3a93756e987579fb7bbbf9b5b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d0e24a58c056e37aa94208947f43a826c65eb774
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54b4397f9370644de20b913310f1d7bb7e423e6d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fcff2e88e5352d296b99073d88a36f7fb5e3b86c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e045eff14a90c5b92ff1e3d65845ad923b279984
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:00bb6248e41b52ca1356716512f1773a76e60155
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1aa939183f4e5998edf2567b9a78dd7066b9dd4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:307dec834ba1f86fd0fbfbd41c27ee02f472db1e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:eb4fbde455e92dc620d81aa5ce351d40ddfc891e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f85b75fd78403cbb858b16ea49348337f0ebcda7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27ffa62c36353b706452be74aec6fa89898040de
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a6a0de610c343216fe9c5dadce213efdce9bcc3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:09f442662946027e0a426c78990eae5fe3c88e61
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c79b955cc6c701e2431e4cfe30681cf9c6d56474
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7755cd2c21308449f33a8e9fb08b9f732a16b50e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e58ac90357d6454f89f79422ae5bf416871939b4
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2279c57b2d0782b64fd4195c4249387b0333b0d0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6eaa47b32b1b906c16f82d7e015d278727f3a504
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04fc8015742da44051148c0d7bc51384c9e55a6f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd8c6decfa6750052036912954f8f8da682c72d5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9f018695990328a7b2eda2077765b7919393906a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cd21b5a2ed0716e81d4774b833c5dd2b3c00bb72
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:87a53b7bfbf9e8b56bc4b9189a6905fdac0476e8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d461c2bef86b0e1e37df3f935886508e103e9ec
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba8019f3ca0b7e10636f488d3c5c627bf5a4a466
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:638a654de12947e6a72e8db469f89d6b44d8925e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16e1a41079ae86aa658de1dec6a6931488ab5c17
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:847bf5bfdfc5f1ea170656c7de76e3029922cc22
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28fad07532f0707627271e9f8b1b965cf3e51dbe
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be80c64cde64b472f096f21527073ea0f2945f33
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48456d2f83ea8a0c49b75202b90c2c28346118d2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cfb59a9e9665ea80002428b55a2642c9c7bd0f83
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:92a6e346a58f272ab0254f52f7a87722ae4150e1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f485f5d20933cf4b541d40f2e502c0df977baf8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4519dad46ba252f6d55f4f389e8b5e7795219ecd
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b18397202823786c49ff62805c47529bdf14d2ec
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d0958bf08a0dd96fafffa5ac6bf725c0ef283998
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c79b7a0710564c1853af4bdb9f8bc83e067c72a1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d6f86ff6ac118c17a31ecffc1400cc623d67c8b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b52f77addf62b63f9224a5080a0aeded85ab19d2
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8f2281e3b030026da14722233deeadf78f8c16a0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:071ea021a987ee79065b0943e9c2b1366419492a
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f25b82c512a96e2bdd64324b1bbda9c6b9bc1d8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b022807790de1f63c2f3fa3157cef52430c8e8ca
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8b565428910e94e8ef00cfaae4236e3ea9036cb7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9bafdcf24c9edd64152f0fd918e7741900ea25f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6c5238403c20351e16513550996fbbfd9b998371
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8083376614dafa70ef61066190bc62cd0d5e4f37
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f23de34fd9670631a5dc4ba5c2cd52021d9abf79
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b023880c0ccbce9697300c572040d43b7a1b8b4b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b95fcb6f4dedc21402fb7c2b122759151420dba0
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:08925ff92b62a2d45124d68d61946381134fd483
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cad9c83ab2bfad9553c3b1f92a23ef054fe76e33
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd2716d0721004e0ec2681686c4ac838e9295a5d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c1791938fc9a2d55ef44c93065f9533baca853e9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a406a721148434004678399fec0bdaa9072f4a5
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb0aa0a830694436ad265ee80dc1f09dcff04530
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2b05cdec22503129a66131f794d99c4add73f834
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d588d1deafcbdbe47e39c3e8b7e746b8b2320882
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de78cf1cf0f76c9d20456adbc809a1c538081e67
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e685ed026ab139792fe734aa02f10ef08782536d
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9fb849eeb169196ae16adbb79ccbf558f8db0719
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec6279bc51114bb5f6e83a17e7ac58b1c0b6c163
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5954740c652fdee2a497582bf8ffbd0c0e95e914
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fdc158acb5924894e54389ab1cd91becb17756d8
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28f0c63bcd9389fd5318df15f14a526835490aa1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e3955797375e108e34a36fc3c32c585236fde591
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa397b7bab96b2254a55041ddb0119492897c17e
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5ea10800c68cd2f12e4c40b6d0e63229c3b9d02
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ae92511a5e94ae5f3ae0b1285f78fcb6e854523
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:403b0d2c7abae739b4147885818c14731c0aaa44
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b512aba418a4f83b9d3abdb9c16fb6b9354f5fb
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a26b5ed4d2d592c80c0e06ecff56978f53952de9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c3aa7ec40b8b00cc6d3c1399b1a82b8a79de936
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58f2c60b0969850bb62b8900ab183a8f12df6496
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0deaad931795535b43e049baa20ad99ca630cd26
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8fabf9cfba4655ab76dc5312de56deb56ebcff9
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec24af6cc1a53c0d7d36a495e25cc2d60f041d5b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29b2bbe80d6107be0d66187f9267866713ad9aa7
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:164f25cd200c1d73916c0732352998422dceb91c
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:822045167a6cf6c2b2962fe318e76e7aaf60113f
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:00f869a2aab8f1d65a83202046773c7ff41cad87
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c5c81c0ea187e6bbc929575a5101726e6474c99
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:95e25396f17ed804df0821ea700b3ebaac5c0fc1
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a62b0522e242df65de3c314003577c1812331da3
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e1875b585a9581a6ef0922566f659c7c8e273e56
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:20ad4e230fb62ca1cf17975107f8ff31ead0761b
11/22/2024 01:38:11 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:26f4252d121324bcee9fa38c003e3d8ebf25568c
11/22/2024 01:38:12 PM UTC [INFO] Received an event for node: 67406dee11fb139cb87dfee9
11/22/2024 01:38:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dee11fb139cb87dfee9
11/22/2024 01:38:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dee11fb139cb87dfee9
11/22/2024 01:38:15 PM UTC [INFO] Received an event for node: 67406dee11fb139cb87dfee6
11/22/2024 01:38:17 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406dee11fb139cb87dfee6
11/22/2024 01:38:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406dee11fb139cb87dfee6
11/22/2024 01:38:17 PM UTC [INFO] Received an event for node: 674070d811fb139cb87e2201
11/22/2024 01:38:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d811fb139cb87e2201
11/22/2024 01:38:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740736211fb139cb87e2bd6
11/22/2024 01:38:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740736211fb139cb87e2bd7
11/22/2024 01:38:19 PM UTC [INFO] Received an event for node: 67406def11fb139cb87dfeec
11/22/2024 01:38:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.610191] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.618112] Modules linked in:\n[    4.621172] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.632468] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.641939] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.646385] Code: 48 8b 15 c4 43 90 70 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.665132] RSP: 0018:ffff9a6d80033b60 EFLAGS: 00010246\n[    4.670358] RAX: 0000000000000000 RBX: ffff9683462bbd08 RCX: 0000000000000000\n[    4.677492] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9a6d80033bc0\n[    4.684629] RBP: ffff9683462bbd08 R08: ffff9683462b1fa0 R09: ffff968341a63000\n[    4.691764] R10: 0000000000000040 R11: ffffffff92d2fd88 R12: ffff968346280000\n[    4.698899] R13: ffff9683462b4fe0 R14: ffff9a6d80033b68 R15: 0000000000000001\n[    4.706033] FS:  0000000000000000(0000) GS:ffff968466e00000(0000) knlGS:0000000000000000\n[    4.714128] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.719875] CR2: ffff96846f1ff000 CR3: 000000003f028000 CR4: 00000000003506f0\n[    4.727010] Call Trace:\n[    4.729461]  <TASK>\n[    4.731564]  ? __warn+0x85/0x130\n[    4.734802]  ? __flush_work+0x29f/0x2c0\n[    4.738659]  ? report_bug+0x160/0x190\n[    4.742330]  ? handle_bug+0x53/0x90\n[    4.745825]  ? exc_invalid_op+0x13/0x60\n[    4.749676]  ? asm_exc_invalid_op+0x16/0x20\n[    4.753865]  ? __flush_work+0x29f/0x2c0\n[    4.757707]  cancel_delayed_work_sync+0x6e/0x90\n[    4.762239]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.766772]  amdgpu_ring_alloc+0x3f/0x60\n[    4.770703]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.775844]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.780292]  amdgpu_device_init+0x205f/0x26f0\n[    4.784653]  amdgpu_driver_load_kms+0x15/0x80\n[    4.789013]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.793027]  pci_device_probe+0x98/0x120\n[    4.796956]  really_probe+0xd1/0x2b0\n[    4.800540]  ? __device_attach_driver+0xc0/0xc0\n[    4.805071]  __driver_probe_device+0x73/0x120\n[    4.809429]  driver_probe_device+0x1f/0x90\n[    4.813530]  __driver_attach+0x84/0x130\n[    4.817369]  bus_for_each_dev+0x84/0xd0\n[    4.821209]  bus_add_driver+0xe4/0x210\n[    4.824965]  driver_register+0x55/0x100\n[    4.828803]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.833597]  do_one_initcall+0x57/0x300\n[    4.837439]  kernel_init_freeable+0x1be/0x300\n[    4.841799]  ? rest_init+0xc0/0xc0\n[    4.845206]  kernel_init+0x16/0x1b0\n[    4.848699]  ret_from_fork+0x30/0x50\n[    4.852277]  ? rest_init+0xc0/0xc0\n[    4.855686]  ret_from_fork_asm+0x11/0x20\n[    4.859617]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.056318] WARNING: CPU: 1 PID: 56 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.064327] Modules linked in:\n[    5.067390] CPU: 1 UID: 0 PID: 56 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.080421] Tainted: [W]=WARN\n[    5.083391] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.092866] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.099315] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.103767] Code: 48 8b 15 c4 43 90 70 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.122519] RSP: 0018:ffff9a6d80293c58 EFLAGS: 00010246\n[    5.127755] RAX: 0000000000000000 RBX: ffff9683462bbd08 RCX: 0000000000000000\n[    5.134891] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9a6d80293cb8\n[    5.142026] RBP: ffff9683462bbd08 R08: ffff9a6d80293de8 R09: 0000000000000000\n[    5.149160] R10: ffff9a6d80293b30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.156297] R13: ffff9683462b4fe0 R14: ffff9a6d80293c60 R15: 0000000000000001\n[    5.163435] FS:  0000000000000000(0000) GS:ffff968466e80000(0000) knlGS:0000000000000000\n[    5.171527] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.177276] CR2: 0000000000000000 CR3: 000000003f028000 CR4: 00000000003506f0\n[    5.184412] Call Trace:\n[    5.186869]  <TASK>\n[    5.188974]  ? __warn+0x85/0x130\n[    5.192208]  ? __flush_work+0x29f/0x2c0\n[    5.196051]  ? report_bug+0x160/0x190\n[    5.199725]  ? handle_bug+0x53/0x90\n[    5.203222]  ? exc_invalid_op+0x13/0x60\n[    5.207069]  ? asm_exc_invalid_op+0x16/0x20\n[    5.211262]  ? __flush_work+0x29f/0x2c0\n[    5.215111]  cancel_delayed_work_sync+0x6e/0x90\n[    5.219647]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.224185]  amdgpu_ring_alloc+0x3f/0x60\n[    5.228119]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.232227]  amdgpu_job_submit_direct+0x30/0x50\n[    5.236765]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.241737]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.246100]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.251942]  process_one_work+0x18b/0x3d0\n[    5.255960]  worker_thread+0x2e4/0x420\n[    5.259719]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.264603]  ? rescuer_thread+0x5d0/0x5d0\n[    5.268619]  kthread+0xdf/0x110\n[    5.271769]  ? kthread_park+0x90/0x90\n[    5.275439]  ret_from_fork+0x30/0x50\n[    5.279026]  ? kthread_park+0x90/0x90\n[    5.282696]  ret_from_fork_asm+0x11/0x20\n[    5.286632]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.636386] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.644306] Modules linked in:\n[    4.647363] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.658657] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.668130] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.672578] Code: 48 8b 15 c4 43 f0 7c 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.691326] RSP: 0018:ffffb10840033b60 EFLAGS: 00010246\n[    4.696553] RAX: 0000000000000000 RBX: ffff9750c67bbd08 RCX: 0000000000000000\n[    4.703686] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb10840033bc0\n[    4.710819] RBP: ffff9750c67bbd08 R08: ffff9750c67b1fa0 R09: ffff9750c1f83000\n[    4.717950] R10: 0000000000000040 R11: ffffffff8672fd88 R12: ffff9750c6780000\n[    4.725081] R13: ffff9750c67b4fe0 R14: ffffb10840033b68 R15: 0000000000000001\n[    4.732212] FS:  0000000000000000(0000) GS:ffff9751e6e80000(0000) knlGS:0000000000000000\n[    4.740302] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.746049] CR2: 0000000000000000 CR3: 0000000091828000 CR4: 00000000003506f0\n[    4.753180] Call Trace:\n[    4.755632]  <TASK>\n[    4.757737]  ? __warn+0x85/0x130\n[    4.760970]  ? __flush_work+0x29f/0x2c0\n[    4.764808]  ? report_bug+0x160/0x190\n[    4.768477]  ? handle_bug+0x53/0x90\n[    4.771970]  ? exc_invalid_op+0x13/0x60\n[    4.775811]  ? asm_exc_invalid_op+0x16/0x20\n[    4.779999]  ? __flush_work+0x29f/0x2c0\n[    4.783842]  cancel_delayed_work_sync+0x6e/0x90\n[    4.788376]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.792913]  amdgpu_ring_alloc+0x3f/0x60\n[    4.796842]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.801981]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.806426]  amdgpu_device_init+0x205f/0x26f0\n[    4.810790]  amdgpu_driver_load_kms+0x15/0x80\n[    4.815152]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.819168]  pci_device_probe+0x98/0x120\n[    4.823094]  really_probe+0xd1/0x2b0\n[    4.826675]  ? __device_attach_driver+0xc0/0xc0\n[    4.831210]  __driver_probe_device+0x73/0x120\n[    4.835569]  driver_probe_device+0x1f/0x90\n[    4.839670]  __driver_attach+0x84/0x130\n[    4.843509]  bus_for_each_dev+0x84/0xd0\n[    4.847351]  bus_add_driver+0xe4/0x210\n[    4.851108]  driver_register+0x55/0x100\n[    4.854946]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.859741]  do_one_initcall+0x57/0x300\n[    4.863586]  kernel_init_freeable+0x1be/0x300\n[    4.867948]  ? rest_init+0xc0/0xc0\n[    4.871354]  kernel_init+0x16/0x1b0\n[    4.874848]  ret_from_fork+0x30/0x50\n[    4.878428]  ? rest_init+0xc0/0xc0\n[    4.881836]  ret_from_fork_asm+0x11/0x20\n[    4.885764]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.082345] WARNING: CPU: 1 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.090356] Modules linked in:\n[    5.093415] CPU: 1 UID: 0 PID: 57 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.106449] Tainted: [W]=WARN\n[    5.109420] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.118894] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.125342] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.129792] Code: 48 8b 15 c4 43 f0 7c 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.148543] RSP: 0018:ffffb1084029bc58 EFLAGS: 00010246\n[    5.153775] RAX: 0000000000000000 RBX: ffff9750c67bbd08 RCX: 0000000000000000\n[    5.160909] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb1084029bcb8\n[    5.168043] RBP: ffff9750c67bbd08 R08: ffffb1084029bde8 R09: 0000000000000000\n[    5.175178] R10: ffffb1084029bb30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.182314] R13: ffff9750c67b4fe0 R14: ffffb1084029bc60 R15: 0000000000000001\n[    5.189449] FS:  0000000000000000(0000) GS:ffff9751e6e80000(0000) knlGS:0000000000000000\n[    5.197536] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.203290] CR2: 0000000000000000 CR3: 0000000091828000 CR4: 00000000003506f0\n[    5.210425] Call Trace:\n[    5.212876]  <TASK>\n[    5.214985]  ? __warn+0x85/0x130\n[    5.218220]  ? __flush_work+0x29f/0x2c0\n[    5.222063]  ? report_bug+0x160/0x190\n[    5.225737]  ? handle_bug+0x53/0x90\n[    5.229235]  ? exc_invalid_op+0x13/0x60\n[    5.233078]  ? asm_exc_invalid_op+0x16/0x20\n[    5.237274]  ? __flush_work+0x29f/0x2c0\n[    5.241123]  cancel_delayed_work_sync+0x6e/0x90\n[    5.245663]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.250205]  amdgpu_ring_alloc+0x3f/0x60\n[    5.254136]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.258243]  amdgpu_job_submit_direct+0x30/0x50\n[    5.262785]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.267759]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.272123]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.277961]  process_one_work+0x18b/0x3d0\n[    5.281979]  worker_thread+0x2e4/0x420\n[    5.285736]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.290621]  ? rescuer_thread+0x5d0/0x5d0\n[    5.294637]  kthread+0xdf/0x110\n[    5.297784]  ? kthread_park+0x90/0x90\n[    5.301454]  ret_from_fork+0x30/0x50\n[    5.305038]  ? kthread_park+0x90/0x90\n[    5.308709]  ret_from_fork_asm+0x11/0x20\n[    5.312643]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.587375] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.595293] Modules linked in:\n[    4.598355] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.609647] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.619119] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.623567] Code: 48 8b 15 c4 43 70 44 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.642323] RSP: 0018:ffffac0600033b60 EFLAGS: 00010246\n[    4.647553] RAX: 0000000000000000 RBX: ffff8d78462bbd08 RCX: 0000000000000000\n[    4.654683] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffac0600033bc0\n[    4.661813] RBP: ffff8d78462bbd08 R08: ffff8d78462b1fa0 R09: ffff8d7842078000\n[    4.668944] R10: 0000000000000040 R11: ffffffffbef2fd88 R12: ffff8d7846280000\n[    4.676075] R13: ffff8d78462b4fe0 R14: ffffac0600033b68 R15: 0000000000000001\n[    4.683204] FS:  0000000000000000(0000) GS:ffff8d7967180000(0000) knlGS:0000000000000000\n[    4.691289] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.697034] CR2: 0000000000000000 CR3: 00000001cf028000 CR4: 00000000003506f0\n[    4.704166] Call Trace:\n[    4.706619]  <TASK>\n[    4.708724]  ? __warn+0x85/0x130\n[    4.711958]  ? __flush_work+0x29f/0x2c0\n[    4.715796]  ? report_bug+0x160/0x190\n[    4.719464]  ? handle_bug+0x53/0x90\n[    4.722957]  ? exc_invalid_op+0x13/0x60\n[    4.726795]  ? asm_exc_invalid_op+0x16/0x20\n[    4.730987]  ? __flush_work+0x29f/0x2c0\n[    4.734829]  cancel_delayed_work_sync+0x6e/0x90\n[    4.739360]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.743897]  amdgpu_ring_alloc+0x3f/0x60\n[    4.747826]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.752966]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.757413]  amdgpu_device_init+0x205f/0x26f0\n[    4.761774]  amdgpu_driver_load_kms+0x15/0x80\n[    4.766131]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.770145]  pci_device_probe+0x98/0x120\n[    4.774073]  really_probe+0xd1/0x2b0\n[    4.777656]  ? __device_attach_driver+0xc0/0xc0\n[    4.782187]  __driver_probe_device+0x73/0x120\n[    4.786545]  driver_probe_device+0x1f/0x90\n[    4.790645]  __driver_attach+0x84/0x130\n[    4.794484]  bus_for_each_dev+0x84/0xd0\n[    4.798323]  bus_add_driver+0xe4/0x210\n[    4.802078]  driver_register+0x55/0x100\n[    4.805914]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.810707]  do_one_initcall+0x57/0x300\n[    4.814547]  kernel_init_freeable+0x1be/0x300\n[    4.818912]  ? rest_init+0xc0/0xc0\n[    4.822319]  kernel_init+0x16/0x1b0\n[    4.825809]  ret_from_fork+0x30/0x50\n[    4.829392]  ? rest_init+0xc0/0xc0\n[    4.832800]  ret_from_fork_asm+0x11/0x20\n[    4.836730]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.033836] WARNING: CPU: 3 PID: 41 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.041848] Modules linked in:\n[    5.044910] CPU: 3 UID: 0 PID: 41 Comm: kworker/3:0 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.057941] Tainted: [W]=WARN\n[    5.060911] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    5.070385] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.076834] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.081285] Code: 48 8b 15 c4 43 70 44 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.100034] RSP: 0018:ffffac0600217c58 EFLAGS: 00010246\n[    5.105265] RAX: 0000000000000000 RBX: ffff8d78462bbd08 RCX: 0000000000000000\n[    5.112400] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffac0600217cb8\n[    5.119534] RBP: ffff8d78462bbd08 R08: ffffac0600217de8 R09: 0000000000000000\n[    5.126668] R10: ffffac0600217b30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.133803] R13: ffff8d78462b4fe0 R14: ffffac0600217c60 R15: 0000000000000001\n[    5.140938] FS:  0000000000000000(0000) GS:ffff8d7967180000(0000) knlGS:0000000000000000\n[    5.149029] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.154779] CR2: 0000000000000000 CR3: 00000001cf028000 CR4: 00000000003506f0\n[    5.161911] Call Trace:\n[    5.164363]  <TASK>\n[    5.166470]  ? __warn+0x85/0x130\n[    5.169707]  ? __flush_work+0x29f/0x2c0\n[    5.173545]  ? report_bug+0x160/0x190\n[    5.177218]  ? handle_bug+0x53/0x90\n[    5.180714]  ? exc_invalid_op+0x13/0x60\n[    5.184552]  ? asm_exc_invalid_op+0x16/0x20\n[    5.188742]  ? __flush_work+0x29f/0x2c0\n[    5.192584]  cancel_delayed_work_sync+0x6e/0x90\n[    5.197127]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.201666]  amdgpu_ring_alloc+0x3f/0x60\n[    5.205597]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.209702]  amdgpu_job_submit_direct+0x30/0x50\n[    5.214241]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.219210]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.223574]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.229409]  process_one_work+0x18b/0x3d0\n[    5.233427]  worker_thread+0x2e4/0x420\n[    5.237184]  ? rescuer_thread+0x5d0/0x5d0\n[    5.241197]  kthread+0xdf/0x110\n[    5.244342]  ? kthread_park+0x90/0x90\n[    5.248009]  ret_from_fork+0x30/0x50\n[    5.251592]  ? kthread_park+0x90/0x90\n[    5.255256]  ret_from_fork_asm+0x11/0x20\n[    5.259189]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52d2c0afa3b1da24409dff8a965961829643ea04', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406def11fb139cb87dfeec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406def11fb139cb87dfeec
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52d2c0afa3b1da24409dff8a965961829643ea04
11/22/2024 01:38:22 PM UTC [INFO] Received an event for node: 67406df111fb139cb87dff0b
11/22/2024 01:38:24 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.294284] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.302205] Modules linked in:\n[    4.305264] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.316559] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.325686] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.330137] Code: 48 8b 15 c4 43 b0 73 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.348885] RSP: 0018:ffff961980033b60 EFLAGS: 00010246\n[    4.354114] RAX: 0000000000000000 RBX: ffff8d98c5e3bd08 RCX: 0000000000000000\n[    4.361248] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff961980033bc0\n[    4.368382] RBP: ffff8d98c5e3bd08 R08: ffff8d98c5e31fa0 R09: ffff8d98c0b68000\n[    4.375513] R10: 0000000000000040 R11: ffffffff8fb2fd88 R12: ffff8d98c5e00000\n[    4.382647] R13: ffff8d98c5e34fe0 R14: ffff961980033b68 R15: 0000000000000001\n[    4.389780] FS:  0000000000000000(0000) GS:ffff8d98eaf80000(0000) knlGS:0000000000000000\n[    4.397862] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.403609] CR2: 0000000000000000 CR3: 00000000bd428000 CR4: 00000000003506f0\n[    4.410740] Call Trace:\n[    4.413195]  <TASK>\n[    4.415300]  ? __warn+0x85/0x130\n[    4.418536]  ? __flush_work+0x29f/0x2c0\n[    4.422377]  ? report_bug+0x160/0x190\n[    4.426046]  ? handle_bug+0x53/0x90\n[    4.429541]  ? exc_invalid_op+0x13/0x60\n[    4.433381]  ? asm_exc_invalid_op+0x16/0x20\n[    4.437569]  ? __flush_work+0x29f/0x2c0\n[    4.441412]  cancel_delayed_work_sync+0x6e/0x90\n[    4.445944]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.450478]  amdgpu_ring_alloc+0x3f/0x60\n[    4.454409]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.459549]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.463996]  amdgpu_device_init+0x205f/0x26f0\n[    4.468358]  amdgpu_driver_load_kms+0x15/0x80\n[    4.472716]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.476731]  pci_device_probe+0x98/0x120\n[    4.480661]  really_probe+0xd1/0x2b0\n[    4.484245]  ? __device_attach_driver+0xc0/0xc0\n[    4.488781]  __driver_probe_device+0x73/0x120\n[    4.493140]  driver_probe_device+0x1f/0x90\n[    4.497241]  __driver_attach+0x84/0x130\n[    4.501080]  bus_for_each_dev+0x84/0xd0\n[    4.504921]  bus_add_driver+0xe4/0x210\n[    4.508677]  driver_register+0x55/0x100\n[    4.512516]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.517310]  do_one_initcall+0x57/0x300\n[    4.521151]  kernel_init_freeable+0x1be/0x300\n[    4.525511]  ? rest_init+0xc0/0xc0\n[    4.528916]  kernel_init+0x16/0x1b0\n[    4.532407]  ret_from_fork+0x30/0x50\n[    4.535990]  ? rest_init+0xc0/0xc0\n[    4.539393]  ret_from_fork_asm+0x11/0x20\n[    4.543325]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.740531] WARNING: CPU: 2 PID: 64 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.748537] Modules linked in:\n[    4.751596] CPU: 2 UID: 0 PID: 64 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.764626] Tainted: [W]=WARN\n[    4.767596] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.776723] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.783168] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.787618] Code: 48 8b 15 c4 43 b0 73 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.806364] RSP: 0018:ffff9619802dbc58 EFLAGS: 00010246\n[    4.811594] RAX: 0000000000000000 RBX: ffff8d98c5e3bd08 RCX: 0000000000000000\n[    4.818728] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9619802dbcb8\n[    4.825860] RBP: ffff8d98c5e3bd08 R08: ffff9619802dbde8 R09: 0000000000000000\n[    4.832995] R10: ffff9619802dbb30 R11: 0000000000000006 R12: 00000000000003e8\n[    4.840129] R13: ffff8d98c5e34fe0 R14: ffff9619802dbc60 R15: 0000000000000001\n[    4.847264] FS:  0000000000000000(0000) GS:ffff8d98eaf00000(0000) knlGS:0000000000000000\n[    4.855349] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.861100] CR2: 0000000000000000 CR3: 00000000bd428000 CR4: 00000000003506f0\n[    4.868234] Call Trace:\n[    4.870687]  <TASK>\n[    4.872793]  ? __warn+0x85/0x130\n[    4.876030]  ? __flush_work+0x29f/0x2c0\n[    4.879872]  ? report_bug+0x160/0x190\n[    4.883542]  ? handle_bug+0x53/0x90\n[    4.887036]  ? exc_invalid_op+0x13/0x60\n[    4.890875]  ? asm_exc_invalid_op+0x16/0x20\n[    4.895063]  ? __flush_work+0x29f/0x2c0\n[    4.898906]  cancel_delayed_work_sync+0x6e/0x90\n[    4.903438]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.907973]  amdgpu_ring_alloc+0x3f/0x60\n[    4.911905]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.916011]  amdgpu_job_submit_direct+0x30/0x50\n[    4.920546]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.925516]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.929876]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    4.935712]  process_one_work+0x18b/0x3d0\n[    4.939727]  worker_thread+0x2e4/0x420\n[    4.943483]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    4.948369]  ? rescuer_thread+0x5d0/0x5d0\n[    4.952382]  kthread+0xdf/0x110\n[    4.955531]  ? kthread_park+0x90/0x90\n[    4.959198]  ret_from_fork+0x30/0x50\n[    4.962780]  ? kthread_park+0x90/0x90\n[    4.966445]  ret_from_fork_asm+0x11/0x20\n[    4.970378]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.305155] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.313073] Modules linked in:\n[    4.316135] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.327426] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.336554] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.341003] Code: 48 8b 15 c4 43 f0 50 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.359752] RSP: 0018:ffffbb0fc0033b60 EFLAGS: 00010246\n[    4.364980] RAX: 0000000000000000 RBX: ffff989605e3bd08 RCX: 0000000000000000\n[    4.372112] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbb0fc0033bc0\n[    4.379242] RBP: ffff989605e3bd08 R08: ffff989605e31fa0 R09: ffff989606258000\n[    4.386374] R10: 0000000000000040 R11: ffffffffb272fd88 R12: ffff989605e00000\n[    4.393504] R13: ffff989605e34fe0 R14: ffffbb0fc0033b68 R15: 0000000000000001\n[    4.400637] FS:  0000000000000000(0000) GS:ffff98962af80000(0000) knlGS:0000000000000000\n[    4.408720] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.414466] CR2: 0000000000000000 CR3: 000000005f428000 CR4: 00000000003506f0\n[    4.421599] Call Trace:\n[    4.424055]  <TASK>\n[    4.426159]  ? __warn+0x85/0x130\n[    4.429394]  ? __flush_work+0x29f/0x2c0\n[    4.433233]  ? report_bug+0x160/0x190\n[    4.436901]  ? handle_bug+0x53/0x90\n[    4.440394]  ? exc_invalid_op+0x13/0x60\n[    4.444233]  ? asm_exc_invalid_op+0x16/0x20\n[    4.448422]  ? __flush_work+0x29f/0x2c0\n[    4.452264]  cancel_delayed_work_sync+0x6e/0x90\n[    4.456796]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.461330]  amdgpu_ring_alloc+0x3f/0x60\n[    4.465258]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.470398]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.474846]  amdgpu_device_init+0x205f/0x26f0\n[    4.479208]  amdgpu_driver_load_kms+0x15/0x80\n[    4.483566]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.487582]  pci_device_probe+0x98/0x120\n[    4.491513]  really_probe+0xd1/0x2b0\n[    4.495093]  ? __device_attach_driver+0xc0/0xc0\n[    4.499625]  __driver_probe_device+0x73/0x120\n[    4.503983]  driver_probe_device+0x1f/0x90\n[    4.508084]  __driver_attach+0x84/0x130\n[    4.511923]  bus_for_each_dev+0x84/0xd0\n[    4.515764]  bus_add_driver+0xe4/0x210\n[    4.519520]  driver_register+0x55/0x100\n[    4.523359]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.528152]  do_one_initcall+0x57/0x300\n[    4.531994]  kernel_init_freeable+0x1be/0x300\n[    4.536353]  ? rest_init+0xc0/0xc0\n[    4.539758]  kernel_init+0x16/0x1b0\n[    4.543249]  ret_from_fork+0x30/0x50\n[    4.546833]  ? rest_init+0xc0/0xc0\n[    4.550238]  ret_from_fork_asm+0x11/0x20\n[    4.554168]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.751342] WARNING: CPU: 2 PID: 74 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.759353] Modules linked in:\n[    4.762416] CPU: 2 UID: 0 PID: 74 Comm: kworker/2:2 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.775448] Tainted: [W]=WARN\n[    4.778419] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.787547] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.793995] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.798445] Code: 48 8b 15 c4 43 f0 50 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.817198] RSP: 0018:ffffbb0fc0303c58 EFLAGS: 00010246\n[    4.822430] RAX: 0000000000000000 RBX: ffff989605e3bd08 RCX: 0000000000000000\n[    4.829566] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbb0fc0303cb8\n[    4.836700] RBP: ffff989605e3bd08 R08: ffffbb0fc0303de8 R09: 0000000000000000\n[    4.843834] R10: ffffbb0fc0303b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.850969] R13: ffff989605e34fe0 R14: ffffbb0fc0303c60 R15: 0000000000000001\n[    4.858104] FS:  0000000000000000(0000) GS:ffff98962af00000(0000) knlGS:0000000000000000\n[    4.866197] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.871944] CR2: 0000000000000000 CR3: 000000005f428000 CR4: 00000000003506f0\n[    4.879081] Call Trace:\n[    4.881535]  <TASK>\n[    4.883644]  ? __warn+0x85/0x130\n[    4.886882]  ? __flush_work+0x29f/0x2c0\n[    4.890730]  ? report_bug+0x160/0x190\n[    4.894402]  ? handle_bug+0x53/0x90\n[    4.897897]  ? exc_invalid_op+0x13/0x60\n[    4.901741]  ? asm_exc_invalid_op+0x16/0x20\n[    4.905941]  ? __flush_work+0x29f/0x2c0\n[    4.909788]  cancel_delayed_work_sync+0x6e/0x90\n[    4.914328]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.918861]  amdgpu_ring_alloc+0x3f/0x60\n[    4.922792]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.926901]  amdgpu_job_submit_direct+0x30/0x50\n[    4.931443]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.936418]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.940785]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    4.946624]  process_one_work+0x18b/0x3d0\n[    4.950642]  worker_thread+0x2e4/0x420\n[    4.954402]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    4.959290]  ? rescuer_thread+0x5d0/0x5d0\n[    4.963307]  kthread+0xdf/0x110\n[    4.966454]  ? kthread_park+0x90/0x90\n[    4.970114]  ret_from_fork+0x30/0x50\n[    4.973697]  ? kthread_park+0x90/0x90\n[    4.977366]  ret_from_fork_asm+0x11/0x20\n[    4.981303]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.307846] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.315766] Modules linked in:\n[    4.318828] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.330122] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.339251] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.343698] Code: 48 8b 15 c4 43 d0 7b 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.362444] RSP: 0018:ffffbd6500033b60 EFLAGS: 00010246\n[    4.367674] RAX: 0000000000000000 RBX: ffffa04185fbbd08 RCX: 0000000000000000\n[    4.374808] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd6500033bc0\n[    4.381941] RBP: ffffa04185fbbd08 R08: ffffa04185fb1fa0 R09: ffffa04185a88000\n[    4.389074] R10: 0000000000000040 R11: ffffffff8792fd88 R12: ffffa04185f80000\n[    4.396207] R13: ffffa04185fb4fe0 R14: ffffbd6500033b68 R15: 0000000000000001\n[    4.403345] FS:  0000000000000000(0000) GS:ffffa041ab080000(0000) knlGS:0000000000000000\n[    4.411429] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.417174] CR2: 0000000000000000 CR3: 0000000114228000 CR4: 00000000003506f0\n[    4.424307] Call Trace:\n[    4.426758]  <TASK>\n[    4.428865]  ? __warn+0x85/0x130\n[    4.432103]  ? __flush_work+0x29f/0x2c0\n[    4.435945]  ? report_bug+0x160/0x190\n[    4.439617]  ? handle_bug+0x53/0x90\n[    4.443115]  ? exc_invalid_op+0x13/0x60\n[    4.446957]  ? asm_exc_invalid_op+0x16/0x20\n[    4.451151]  ? __flush_work+0x29f/0x2c0\n[    4.455000]  cancel_delayed_work_sync+0x6e/0x90\n[    4.459536]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.464075]  amdgpu_ring_alloc+0x3f/0x60\n[    4.468008]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.473150]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.477601]  amdgpu_device_init+0x205f/0x26f0\n[    4.481968]  amdgpu_driver_load_kms+0x15/0x80\n[    4.486330]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.490348]  pci_device_probe+0x98/0x120\n[    4.494277]  really_probe+0xd1/0x2b0\n[    4.497860]  ? __device_attach_driver+0xc0/0xc0\n[    4.502397]  __driver_probe_device+0x73/0x120\n[    4.506762]  driver_probe_device+0x1f/0x90\n[    4.510865]  __driver_attach+0x84/0x130\n[    4.514707]  bus_for_each_dev+0x84/0xd0\n[    4.518551]  bus_add_driver+0xe4/0x210\n[    4.522309]  driver_register+0x55/0x100\n[    4.526152]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.530952]  do_one_initcall+0x57/0x300\n[    4.534799]  kernel_init_freeable+0x1be/0x300\n[    4.539164]  ? rest_init+0xc0/0xc0\n[    4.542573]  kernel_init+0x16/0x1b0\n[    4.546069]  ret_from_fork+0x30/0x50\n[    4.549651]  ? rest_init+0xc0/0xc0\n[    4.553060]  ret_from_fork_asm+0x11/0x20\n[    4.556991]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.753944] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.761866] Modules linked in:\n[    4.764924] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.777871] Tainted: [W]=WARN\n[    4.780843] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.789969] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.796416] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.800866] Code: 48 8b 15 c4 43 d0 7b 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.819615] RSP: 0018:ffffbd6500073c58 EFLAGS: 00010246\n[    4.824844] RAX: 0000000000000000 RBX: ffffa04185fbbd08 RCX: 0000000000000000\n[    4.831978] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffbd6500073cb8\n[    4.839110] RBP: ffffa04185fbbd08 R08: ffffbd6500073de8 R09: 0000000000000000\n[    4.846243] R10: ffffbd6500073b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.853378] R13: ffffa04185fb4fe0 R14: ffffbd6500073c60 R15: 0000000000000001\n[    4.860512] FS:  0000000000000000(0000) GS:ffffa041ab000000(0000) knlGS:0000000000000000\n[    4.868597] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.874345] CR2: ffffa04195001000 CR3: 0000000114228000 CR4: 00000000003506f0\n[    4.881479] Call Trace:\n[    4.883932]  <TASK>\n[    4.886040]  ? __warn+0x85/0x130\n[    4.889273]  ? __flush_work+0x29f/0x2c0\n[    4.893113]  ? report_bug+0x160/0x190\n[    4.896785]  ? handle_bug+0x53/0x90\n[    4.900277]  ? exc_invalid_op+0x13/0x60\n[    4.904125]  ? asm_exc_invalid_op+0x16/0x20\n[    4.908321]  ? __flush_work+0x29f/0x2c0\n[    4.912167]  cancel_delayed_work_sync+0x6e/0x90\n[    4.916704]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.921244]  amdgpu_ring_alloc+0x3f/0x60\n[    4.925173]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.929283]  amdgpu_job_submit_direct+0x30/0x50\n[    4.933824]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.938799]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.943163]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    4.949002]  process_one_work+0x18b/0x3d0\n[    4.953019]  worker_thread+0x2e4/0x420\n[    4.956775]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    4.961659]  ? rescuer_thread+0x5d0/0x5d0\n[    4.965676]  kthread+0xdf/0x110\n[    4.968822]  ? kthread_park+0x90/0x90\n[    4.972492]  ret_from_fork+0x30/0x50\n[    4.976074]  ? kthread_park+0x90/0x90\n[    4.979745]  ret_from_fork_asm+0x11/0x20\n[    4.983678]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7ae6efc534d484185c818b73661bc981d712a0f', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df111fb139cb87dff0b
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7ae6efc534d484185c818b73661bc981d712a0f
11/22/2024 01:38:24 PM UTC [INFO] Received an event for node: 67406df111fb139cb87dff0e
11/22/2024 01:38:27 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.560732] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.568650] Modules linked in:\n[    4.571709] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.583002] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.591692] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.596140] Code: 48 8b 15 c4 43 f0 67 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.614886] RSP: 0018:ffffb07500033b60 EFLAGS: 00010246\n[    4.620112] RAX: 0000000000000000 RBX: ffff967fc603bd08 RCX: 0000000000000000\n[    4.627246] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb07500033bc0\n[    4.634375] RBP: ffff967fc603bd08 R08: ffff967fc6031fa0 R09: ffff967fc0d13000\n[    4.641505] R10: 0000000000000040 R11: ffffffff9b72fd88 R12: ffff967fc6000000\n[    4.648637] R13: ffff967fc6034fe0 R14: ffffb07500033b68 R15: 0000000000000001\n[    4.655768] FS:  0000000000000000(0000) GS:ffff967feaf80000(0000) knlGS:0000000000000000\n[    4.663854] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.669599] CR2: 0000000000000000 CR3: 0000000096c28000 CR4: 00000000003506f0\n[    4.676729] Call Trace:\n[    4.679181]  <TASK>\n[    4.681287]  ? __warn+0x85/0x130\n[    4.684519]  ? __flush_work+0x29f/0x2c0\n[    4.688359]  ? report_bug+0x160/0x190\n[    4.692025]  ? handle_bug+0x53/0x90\n[    4.695517]  ? exc_invalid_op+0x13/0x60\n[    4.699356]  ? asm_exc_invalid_op+0x16/0x20\n[    4.703545]  ? __flush_work+0x29f/0x2c0\n[    4.707388]  cancel_delayed_work_sync+0x6e/0x90\n[    4.711920]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.716454]  amdgpu_ring_alloc+0x3f/0x60\n[    4.720382]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.725522]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.729970]  amdgpu_device_init+0x205f/0x26f0\n[    4.734330]  amdgpu_driver_load_kms+0x15/0x80\n[    4.738688]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.742700]  pci_device_probe+0x98/0x120\n[    4.746628]  really_probe+0xd1/0x2b0\n[    4.750209]  ? __device_attach_driver+0xc0/0xc0\n[    4.754741]  __driver_probe_device+0x73/0x120\n[    4.759099]  driver_probe_device+0x1f/0x90\n[    4.763200]  __driver_attach+0x84/0x130\n[    4.767041]  bus_for_each_dev+0x84/0xd0\n[    4.770881]  bus_add_driver+0xe4/0x210\n[    4.774634]  driver_register+0x55/0x100\n[    4.778471]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.783264]  do_one_initcall+0x57/0x300\n[    4.787104]  kernel_init_freeable+0x1be/0x300\n[    4.791465]  ? rest_init+0xc0/0xc0\n[    4.794871]  kernel_init+0x16/0x1b0\n[    4.798362]  ret_from_fork+0x30/0x50\n[    4.801943]  ? rest_init+0xc0/0xc0\n[    4.805347]  ret_from_fork_asm+0x11/0x20\n[    4.809275]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.004913] WARNING: CPU: 3 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.012919] Modules linked in:\n[    5.015979] CPU: 3 UID: 0 PID: 57 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.029008] Tainted: [W]=WARN\n[    5.031979] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    5.040671] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.047115] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.051563] Code: 48 8b 15 c4 43 f0 67 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.070310] RSP: 0018:ffffb0750029bc58 EFLAGS: 00010246\n[    5.075537] RAX: 0000000000000000 RBX: ffff967fc603bd08 RCX: 0000000000000000\n[    5.082669] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb0750029bcb8\n[    5.089799] RBP: ffff967fc603bd08 R08: ffffb0750029bde8 R09: 0000000000000000\n[    5.096930] R10: ffffb0750029bb30 R11: 0000000000000001 R12: 00000000000003e8\n[    5.104063] R13: ffff967fc6034fe0 R14: ffffb0750029bc60 R15: 0000000000000001\n[    5.111195] FS:  0000000000000000(0000) GS:ffff967feaf80000(0000) knlGS:0000000000000000\n[    5.119280] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.125026] CR2: 0000000000000000 CR3: 0000000096c28000 CR4: 00000000003506f0\n[    5.132159] Call Trace:\n[    5.134612]  <TASK>\n[    5.136718]  ? __warn+0x85/0x130\n[    5.139951]  ? __flush_work+0x29f/0x2c0\n[    5.143793]  ? report_bug+0x160/0x190\n[    5.147464]  ? handle_bug+0x53/0x90\n[    5.150959]  ? exc_invalid_op+0x13/0x60\n[    5.154801]  ? asm_exc_invalid_op+0x16/0x20\n[    5.158991]  ? __flush_work+0x29f/0x2c0\n[    5.162835]  cancel_delayed_work_sync+0x6e/0x90\n[    5.167370]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.171907]  amdgpu_ring_alloc+0x3f/0x60\n[    5.175836]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.179937]  amdgpu_job_submit_direct+0x30/0x50\n[    5.184473]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.189441]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.193801]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.199635]  process_one_work+0x18b/0x3d0\n[    5.203649]  worker_thread+0x2e4/0x420\n[    5.207402]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.212283]  ? rescuer_thread+0x5d0/0x5d0\n[    5.216296]  kthread+0xdf/0x110\n[    5.219444]  ? kthread_park+0x90/0x90\n[    5.223112]  ret_from_fork+0x30/0x50\n[    5.226691]  ? kthread_park+0x90/0x90\n[    5.230358]  ret_from_fork_asm+0x11/0x20\n[    5.234289]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.562294] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.570215] Modules linked in:\n[    4.573273] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.584565] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.593257] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.597703] Code: 48 8b 15 c4 43 30 61 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.616450] RSP: 0018:ffff9d1fc0033b60 EFLAGS: 00010246\n[    4.621676] RAX: 0000000000000000 RBX: ffff97a685a3bd08 RCX: 0000000000000000\n[    4.628809] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9d1fc0033bc0\n[    4.635941] RBP: ffff97a685a3bd08 R08: ffff97a685a31fa0 R09: ffff97a6811fb000\n[    4.643070] R10: 0000000000000040 R11: ffffffffa232fd88 R12: ffff97a685a00000\n[    4.650202] R13: ffff97a685a34fe0 R14: ffff9d1fc0033b68 R15: 0000000000000001\n[    4.657331] FS:  0000000000000000(0000) GS:ffff97a6aaf00000(0000) knlGS:0000000000000000\n[    4.665417] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.671160] CR2: 0000000000000000 CR3: 000000005e828000 CR4: 00000000003506f0\n[    4.678291] Call Trace:\n[    4.680744]  <TASK>\n[    4.682849]  ? __warn+0x85/0x130\n[    4.686082]  ? __flush_work+0x29f/0x2c0\n[    4.689922]  ? report_bug+0x160/0x190\n[    4.693590]  ? handle_bug+0x53/0x90\n[    4.697083]  ? exc_invalid_op+0x13/0x60\n[    4.700923]  ? asm_exc_invalid_op+0x16/0x20\n[    4.705113]  ? __flush_work+0x29f/0x2c0\n[    4.708956]  cancel_delayed_work_sync+0x6e/0x90\n[    4.713488]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.718021]  amdgpu_ring_alloc+0x3f/0x60\n[    4.721947]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.727085]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.731531]  amdgpu_device_init+0x205f/0x26f0\n[    4.735892]  amdgpu_driver_load_kms+0x15/0x80\n[    4.740251]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.744268]  pci_device_probe+0x98/0x120\n[    4.748193]  really_probe+0xd1/0x2b0\n[    4.751773]  ? __device_attach_driver+0xc0/0xc0\n[    4.756305]  __driver_probe_device+0x73/0x120\n[    4.760664]  driver_probe_device+0x1f/0x90\n[    4.764762]  __driver_attach+0x84/0x130\n[    4.768602]  bus_for_each_dev+0x84/0xd0\n[    4.772443]  bus_add_driver+0xe4/0x210\n[    4.776197]  driver_register+0x55/0x100\n[    4.780035]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.784827]  do_one_initcall+0x57/0x300\n[    4.788669]  kernel_init_freeable+0x1be/0x300\n[    4.793029]  ? rest_init+0xc0/0xc0\n[    4.796435]  kernel_init+0x16/0x1b0\n[    4.799926]  ret_from_fork+0x30/0x50\n[    4.803508]  ? rest_init+0xc0/0xc0\n[    4.806912]  ret_from_fork_asm+0x11/0x20\n[    4.810839]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    5.006837] WARNING: CPU: 3 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    5.014843] Modules linked in:\n[    5.017903] CPU: 3 UID: 0 PID: 57 Comm: kworker/3:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    5.030933] Tainted: [W]=WARN\n[    5.033907] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    5.042599] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    5.049047] RIP: 0010:__flush_work+0x29f/0x2c0\n[    5.053497] Code: 48 8b 15 c4 43 30 61 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    5.072245] RSP: 0018:ffff9d1fc029bc58 EFLAGS: 00010246\n[    5.077474] RAX: 0000000000000000 RBX: ffff97a685a3bd08 RCX: 0000000000000000\n[    5.084608] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff9d1fc029bcb8\n[    5.091743] RBP: ffff97a685a3bd08 R08: ffff9d1fc029bde8 R09: 0000000000000000\n[    5.098876] R10: ffff9d1fc029bb30 R11: 0000000000000000 R12: 00000000000003e8\n[    5.106011] R13: ffff97a685a34fe0 R14: ffff9d1fc029bc60 R15: 0000000000000001\n[    5.113146] FS:  0000000000000000(0000) GS:ffff97a6aaf80000(0000) knlGS:0000000000000000\n[    5.121231] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.126980] CR2: 0000000000000000 CR3: 000000005e828000 CR4: 00000000003506f0\n[    5.134115] Call Trace:\n[    5.136571]  <TASK>\n[    5.138679]  ? __warn+0x85/0x130\n[    5.141912]  ? __flush_work+0x29f/0x2c0\n[    5.145754]  ? report_bug+0x160/0x190\n[    5.149427]  ? handle_bug+0x53/0x90\n[    5.152923]  ? exc_invalid_op+0x13/0x60\n[    5.156765]  ? asm_exc_invalid_op+0x16/0x20\n[    5.160957]  ? __flush_work+0x29f/0x2c0\n[    5.164804]  cancel_delayed_work_sync+0x6e/0x90\n[    5.169341]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.173880]  amdgpu_ring_alloc+0x3f/0x60\n[    5.177812]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.181919]  amdgpu_job_submit_direct+0x30/0x50\n[    5.186460]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.191431]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.195796]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.201637]  process_one_work+0x18b/0x3d0\n[    5.205655]  worker_thread+0x2e4/0x420\n[    5.209412]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.214297]  ? rescuer_thread+0x5d0/0x5d0\n[    5.218315]  kthread+0xdf/0x110\n[    5.221462]  ? kthread_park+0x90/0x90\n[    5.225130]  ret_from_fork+0x30/0x50\n[    5.228711]  ? kthread_park+0x90/0x90\n[    5.232377]  ret_from_fork_asm+0x11/0x20\n[    5.236311]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.475386] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.483306] Modules linked in:\n[    4.486367] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.497661] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.506351] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.510797] Code: 48 8b 15 c4 43 90 62 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.529543] RSP: 0018:ffff91bb40033b60 EFLAGS: 00010246\n[    4.534772] RAX: 0000000000000000 RBX: ffff8bb505e3bd08 RCX: 0000000000000000\n[    4.541904] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff91bb40033bc0\n[    4.549036] RBP: ffff8bb505e3bd08 R08: ffff8bb505e31fa0 R09: ffff8bb501faf000\n[    4.556166] R10: 0000000000000040 R11: ffffffffa0d2fd88 R12: ffff8bb505e00000\n[    4.563298] R13: ffff8bb505e34fe0 R14: ffff91bb40033b68 R15: 0000000000000001\n[    4.570428] FS:  0000000000000000(0000) GS:ffff8bb52ae80000(0000) knlGS:0000000000000000\n[    4.578514] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.584258] CR2: 0000000000000000 CR3: 00000000abc28000 CR4: 00000000003506f0\n[    4.591391] Call Trace:\n[    4.593841]  <TASK>\n[    4.595946]  ? __warn+0x85/0x130\n[    4.599183]  ? __flush_work+0x29f/0x2c0\n[    4.603025]  ? report_bug+0x160/0x190\n[    4.606692]  ? handle_bug+0x53/0x90\n[    4.610186]  ? exc_invalid_op+0x13/0x60\n[    4.614024]  ? asm_exc_invalid_op+0x16/0x20\n[    4.618213]  ? __flush_work+0x29f/0x2c0\n[    4.622055]  cancel_delayed_work_sync+0x6e/0x90\n[    4.626590]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.631124]  amdgpu_ring_alloc+0x3f/0x60\n[    4.635051]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.640194]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.644640]  amdgpu_device_init+0x205f/0x26f0\n[    4.649002]  amdgpu_driver_load_kms+0x15/0x80\n[    4.653361]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.657375]  pci_device_probe+0x98/0x120\n[    4.661301]  really_probe+0xd1/0x2b0\n[    4.664883]  ? __device_attach_driver+0xc0/0xc0\n[    4.669417]  __driver_probe_device+0x73/0x120\n[    4.673777]  driver_probe_device+0x1f/0x90\n[    4.677876]  __driver_attach+0x84/0x130\n[    4.681717]  bus_for_each_dev+0x84/0xd0\n[    4.685558]  bus_add_driver+0xe4/0x210\n[    4.689314]  driver_register+0x55/0x100\n[    4.693152]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.697945]  do_one_initcall+0x57/0x300\n[    4.701787]  kernel_init_freeable+0x1be/0x300\n[    4.706150]  ? rest_init+0xc0/0xc0\n[    4.709559]  kernel_init+0x16/0x1b0\n[    4.713049]  ret_from_fork+0x30/0x50\n[    4.716631]  ? rest_init+0xc0/0xc0\n[    4.720035]  ret_from_fork_asm+0x11/0x20\n[    4.723962]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.919691] WARNING: CPU: 1 PID: 57 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.927697] Modules linked in:\n[    4.930761] CPU: 1 UID: 0 PID: 57 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.943791] Tainted: [W]=WARN\n[    4.946761] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.955456] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.961901] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.966351] Code: 48 8b 15 c4 43 90 62 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.985101] RSP: 0018:ffff91bb4029bc58 EFLAGS: 00010246\n[    4.990331] RAX: 0000000000000000 RBX: ffff8bb505e3bd08 RCX: 0000000000000000\n[    4.997464] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff91bb4029bcb8\n[    5.004589] RBP: ffff8bb505e3bd08 R08: ffff91bb4029bde8 R09: 0000000000000000\n[    5.011720] R10: ffff91bb4029bb30 R11: 0000000000000006 R12: 00000000000003e8\n[    5.018854] R13: ffff8bb505e34fe0 R14: ffff91bb4029bc60 R15: 0000000000000001\n[    5.025986] FS:  0000000000000000(0000) GS:ffff8bb52ae80000(0000) knlGS:0000000000000000\n[    5.034071] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    5.039818] CR2: 0000000000000000 CR3: 00000000abc28000 CR4: 00000000003506f0\n[    5.046952] Call Trace:\n[    5.049405]  <TASK>\n[    5.051511]  ? __warn+0x85/0x130\n[    5.054745]  ? __flush_work+0x29f/0x2c0\n[    5.058589]  ? report_bug+0x160/0x190\n[    5.062261]  ? handle_bug+0x53/0x90\n[    5.065753]  ? exc_invalid_op+0x13/0x60\n[    5.069596]  ? asm_exc_invalid_op+0x16/0x20\n[    5.073787]  ? __flush_work+0x29f/0x2c0\n[    5.077630]  cancel_delayed_work_sync+0x6e/0x90\n[    5.082163]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.086700]  amdgpu_ring_alloc+0x3f/0x60\n[    5.090627]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.094729]  amdgpu_job_submit_direct+0x30/0x50\n[    5.099266]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.104235]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.108598]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.114435]  process_one_work+0x18b/0x3d0\n[    5.118452]  worker_thread+0x2e4/0x420\n[    5.122211]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.127093]  ? rescuer_thread+0x5d0/0x5d0\n[    5.131108]  kthread+0xdf/0x110\n[    5.134253]  ? kthread_park+0x90/0x90\n[    5.137921]  ret_from_fork+0x30/0x50\n[    5.141504]  ? kthread_park+0x90/0x90\n[    5.145172]  ret_from_fork_asm+0x11/0x20\n[    5.149102]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b99fc2a319a3046d329146913cf26a214953e872', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df111fb139cb87dff0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df111fb139cb87dff0e
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b99fc2a319a3046d329146913cf26a214953e872
11/22/2024 01:38:27 PM UTC [INFO] Received an event for node: 67406d3011fb139cb87dfb66
11/22/2024 01:38:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d3011fb139cb87dfb66
11/22/2024 01:38:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3011fb139cb87dfb66
11/22/2024 01:38:29 PM UTC [INFO] Received an event for node: 67406def11fb139cb87dfef7
11/22/2024 01:38:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406def11fb139cb87dfef7
11/22/2024 01:38:32 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406def11fb139cb87dfef7
11/22/2024 01:38:32 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0d98
11/22/2024 01:38:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0d98
11/22/2024 01:38:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d98
11/22/2024 01:38:34 PM UTC [INFO] Received an event for node: 674070bd11fb139cb87e219a
11/22/2024 01:39:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cffc7f5c282d67b03446629fd25bf957454476dd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070bd11fb139cb87e219a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5220339711363ec12c3d0ddc6831a626fd4dc2d2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070bd11fb139cb87e219a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:39:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5df52bd3881b69dfcf7d2fec0c65f7730d95fe17', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740738111fb139cb87e2bf5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8a6bb572fc2cd8cafada7200ebd69fc3880b5a0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740738111fb139cb87e2bf5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:39:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b594da50c47ec905a6abd880496cfdcc2f047859', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740738111fb139cb87e2c7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ba688d2baf60e6ce550dcea09bd692cb4c8779d1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740738111fb139cb87e2c7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bd11fb139cb87e219a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bf5
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bf6
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bf7
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bf8
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bf9
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bfa
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bfb
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bfc
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bfd
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bfe
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2bff
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c00
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c01
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c02
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c03
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c04
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c05
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c06
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c07
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c08
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c09
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c0f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c10
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c11
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c12
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c13
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c14
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c15
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c16
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c17
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c18
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c19
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c1f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c20
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c21
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c22
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c23
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c24
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c25
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c26
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c27
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c28
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c29
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c2f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c30
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c31
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c32
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c33
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c34
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c35
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c36
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c37
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c38
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c39
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c3f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c40
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c41
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c42
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c43
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c44
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c45
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c46
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c47
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c48
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c49
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c4f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c50
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c51
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c52
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c53
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c54
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c55
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c56
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c57
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c58
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c59
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c5f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c60
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c61
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c62
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c63
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c64
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c65
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c66
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c67
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c68
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c69
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c6f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c70
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c71
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c72
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c73
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c74
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c75
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c76
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c77
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c78
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c79
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c7f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c80
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c81
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c82
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c83
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c84
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c85
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c86
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c87
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c88
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c89
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c8f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c90
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c91
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c92
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c93
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c94
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c95
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c96
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c97
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c98
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c99
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9a
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9b
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9c
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9d
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9e
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2c9f
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca0
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca1
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca2
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca3
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca4
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca5
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca6
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca7
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca8
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2ca9
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2caa
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cab
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cac
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cad
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cae
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2caf
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb0
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb1
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb2
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb3
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb4
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb5
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738111fb139cb87e2cb6
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cffc7f5c282d67b03446629fd25bf957454476dd
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5220339711363ec12c3d0ddc6831a626fd4dc2d2
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5df52bd3881b69dfcf7d2fec0c65f7730d95fe17
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8a6bb572fc2cd8cafada7200ebd69fc3880b5a0
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b594da50c47ec905a6abd880496cfdcc2f047859
11/22/2024 01:39:44 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba688d2baf60e6ce550dcea09bd692cb4c8779d1
11/22/2024 01:39:45 PM UTC [INFO] Received an event for node: 67406e8011fb139cb87e0f13
11/22/2024 01:39:46 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f13
11/22/2024 01:39:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f13
11/22/2024 01:39:46 PM UTC [INFO] Received an event for node: 674070c311fb139cb87e21af
11/22/2024 01:39:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c311fb139cb87e21af
11/22/2024 01:39:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738811fb139cb87e2cc0
11/22/2024 01:39:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738811fb139cb87e2cc1
11/22/2024 01:39:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740738811fb139cb87e2cc2
11/22/2024 01:39:49 PM UTC [INFO] Received an event for node: 67406e7d11fb139cb87e0d45
11/22/2024 01:39:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0d45
11/22/2024 01:39:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0d45
11/22/2024 01:39:51 PM UTC [INFO] Received an event for node: 67406e7c11fb139cb87e0bb7
11/22/2024 01:39:53 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bb7
11/22/2024 01:39:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bb7
11/22/2024 01:39:53 PM UTC [INFO] Received an event for node: 67406d2f11fb139cb87dfb58
11/22/2024 01:39:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d2f11fb139cb87dfb58
11/22/2024 01:39:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2f11fb139cb87dfb58
11/22/2024 01:39:55 PM UTC [INFO] Received an event for node: 67406e7d11fb139cb87e0c59
11/22/2024 01:39:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7d11fb139cb87e0c59
11/22/2024 01:39:57 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7d11fb139cb87e0c59
11/22/2024 01:39:57 PM UTC [INFO] Received an event for node: 67406d3311fb139cb87dfb72
11/22/2024 01:39:59 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d3311fb139cb87dfb72
11/22/2024 01:39:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3311fb139cb87dfb72
11/22/2024 01:39:59 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0e21
11/22/2024 01:40:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0e21
11/22/2024 01:40:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0e21
11/22/2024 01:40:02 PM UTC [INFO] Received an event for node: 67406d3111fb139cb87dfb6c
11/22/2024 01:40:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d3111fb139cb87dfb6c
11/22/2024 01:40:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3111fb139cb87dfb6c
11/22/2024 01:40:03 PM UTC [INFO] Received an event for node: 674070c911fb139cb87e21c4
11/22/2024 01:40:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c911fb139cb87e21c4
11/22/2024 01:40:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073b011fb139cb87e2ce4
11/22/2024 01:40:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073b011fb139cb87e2ce5
11/22/2024 01:40:06 PM UTC [INFO] Received an event for node: 6740726811fb139cb87e2873
11/22/2024 01:40:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726811fb139cb87e2873
11/22/2024 01:40:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ba11fb139cb87e2ceb
11/22/2024 01:40:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ba11fb139cb87e2cec
11/22/2024 01:40:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ba11fb139cb87e2ced
11/22/2024 01:40:08 PM UTC [INFO] Received an event for node: 67406e7b11fb139cb87e0bae
11/22/2024 01:40:11 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0bae
11/22/2024 01:40:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0bae
11/22/2024 01:40:11 PM UTC [INFO] Received an event for node: 67406e8011fb139cb87e0f18
11/22/2024 01:40:13 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8011fb139cb87e0f18
11/22/2024 01:40:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8011fb139cb87e0f18
11/22/2024 01:40:13 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0d95
11/22/2024 01:40:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0d95
11/22/2024 01:40:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d95
11/22/2024 01:40:15 PM UTC [INFO] Received an event for node: 6740726911fb139cb87e2876
11/22/2024 01:40:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726911fb139cb87e2876
11/22/2024 01:40:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ee11fb139cb87e2cff
11/22/2024 01:40:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ee11fb139cb87e2d00
11/22/2024 01:40:18 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073ee11fb139cb87e2d01
11/22/2024 01:40:18 PM UTC [INFO] Received an event for node: 6740726511fb139cb87e286d
11/22/2024 01:40:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726511fb139cb87e286d
11/22/2024 01:40:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073f311fb139cb87e2d07
11/22/2024 01:40:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073f311fb139cb87e2d08
11/22/2024 01:40:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073f311fb139cb87e2d09
11/22/2024 01:40:21 PM UTC [INFO] Received an event for node: 674070d511fb139cb87e21f8
11/22/2024 01:40:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d511fb139cb87e21f8
11/22/2024 01:40:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073f411fb139cb87e2d0f
11/22/2024 01:40:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674073f411fb139cb87e2d10
11/22/2024 01:40:22 PM UTC [INFO] Received an event for node: 674070ea11fb139cb87e224a
11/22/2024 01:40:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ea11fb139cb87e224a
11/22/2024 01:40:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740740611fb139cb87e2d16
11/22/2024 01:40:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740740611fb139cb87e2d17
11/22/2024 01:40:25 PM UTC [INFO] Received an event for node: 67406e7b11fb139cb87e0ae8
11/22/2024 01:40:27 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7b11fb139cb87e0ae8
11/22/2024 01:40:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7b11fb139cb87e0ae8
11/22/2024 01:40:27 PM UTC [INFO] Received an event for node: 67406e7c11fb139cb87e0bba
11/22/2024 01:40:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7c11fb139cb87e0bba
11/22/2024 01:40:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7c11fb139cb87e0bba
11/22/2024 01:40:29 PM UTC [INFO] Received an event for node: 6740741811fb139cb87e2d24
11/22/2024 01:40:29 PM UTC [DEBUG] Not sending node to KCIDB: 6740741811fb139cb87e2d24
11/22/2024 01:40:29 PM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa43
11/22/2024 01:40:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa43
11/22/2024 01:40:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa43
11/22/2024 01:40:30 PM UTC [INFO] Received an event for node: 674070ce11fb139cb87e21e3
11/22/2024 01:40:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ce11fb139cb87e21e3
11/22/2024 01:40:32 PM UTC [INFO] Received an event for node: 6740741e11fb139cb87e2d2b
11/22/2024 01:40:32 PM UTC [DEBUG] Not sending node to KCIDB: 6740741e11fb139cb87e2d2b
11/22/2024 01:40:32 PM UTC [INFO] Received an event for node: 67406e2711fb139cb87e02cd
11/22/2024 01:40:32 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e02cd
11/22/2024 01:40:32 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e02cd
11/22/2024 01:40:32 PM UTC [INFO] Received an event for node: 674070ed11fb139cb87e2253
11/22/2024 01:40:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ed11fb139cb87e2253
11/22/2024 01:40:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740742011fb139cb87e2d2f
11/22/2024 01:40:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740742011fb139cb87e2d30
11/22/2024 01:40:35 PM UTC [INFO] Received an event for node: 6740743c11fb139cb87e2d35
11/22/2024 01:40:35 PM UTC [DEBUG] Not sending node to KCIDB: 6740743c11fb139cb87e2d35
11/22/2024 01:40:35 PM UTC [INFO] Received an event for node: 67406e2711fb139cb87e0319
11/22/2024 01:40:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e0319
11/22/2024 01:40:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e0319
11/22/2024 01:40:36 PM UTC [INFO] Received an event for node: 6740743e11fb139cb87e2d38
11/22/2024 01:40:36 PM UTC [DEBUG] Not sending node to KCIDB: 6740743e11fb139cb87e2d38
11/22/2024 01:40:36 PM UTC [INFO] Received an event for node: 67406e2711fb139cb87e031d
11/22/2024 01:40:36 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e031d
11/22/2024 01:40:36 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031d
11/22/2024 01:40:37 PM UTC [INFO] Received an event for node: 6740743e11fb139cb87e2d3b
11/22/2024 01:40:37 PM UTC [DEBUG] Not sending node to KCIDB: 6740743e11fb139cb87e2d3b
11/22/2024 01:40:37 PM UTC [INFO] Received an event for node: 67406e2711fb139cb87e031f
11/22/2024 01:40:37 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e2711fb139cb87e031f
11/22/2024 01:40:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2711fb139cb87e031f
11/22/2024 01:40:38 PM UTC [INFO] Received an event for node: 674070dc11fb139cb87e220a
11/22/2024 01:41:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b257026c1c1916f36b0e5f8f762917ff488cc5f3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070dc11fb139cb87e220a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:964f8a16eff59bb2c1ec1184749352abf7872bd2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070dc11fb139cb87e220a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:41:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f1bbba4b12fe18baabf1b28096222ef27ba15ff5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:41451385b730d2e9247919fe22639c088ffbc776', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:41:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f2a4ee0bcb9d139eccaed6b8f2f25960439f4a74', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5411b437fc3b4a04774902414441a20448b1b74e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:41:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bd60160e2a701d9effe831fb17976b564e1646e4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31d7d10e7e27ea859a6baf56bd4d2c7276a724c9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dc11fb139cb87e220a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d3f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d40
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d41
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d42
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d43
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d44
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d45
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d46
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d47
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d48
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d49
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d4f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d50
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d51
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d52
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d53
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d54
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d55
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d56
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d57
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d58
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d59
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d5f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d60
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d61
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d62
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d63
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d64
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d65
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d66
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d67
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d68
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d69
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d6f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d70
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d71
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d72
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d73
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d74
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d75
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d76
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d77
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d78
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d79
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d7f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d80
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d81
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d82
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d83
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d84
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d85
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d86
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d87
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d88
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d89
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d90
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d91
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d92
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d93
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d94
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d95
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d96
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d97
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d98
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d99
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9a
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9b
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9c
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9d
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d9f
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da0
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da1
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da2
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da3
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da4
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da5
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da6
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da7
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da8
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2da9
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2daa
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dab
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dac
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dad
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dae
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2daf
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db0
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db1
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db2
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db3
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db4
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db5
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db6
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db7
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db8
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2db9
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dba
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dbb
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dbc
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dbd
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dbe
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2dbf
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b257026c1c1916f36b0e5f8f762917ff488cc5f3
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:964f8a16eff59bb2c1ec1184749352abf7872bd2
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1bbba4b12fe18baabf1b28096222ef27ba15ff5
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41451385b730d2e9247919fe22639c088ffbc776
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2a4ee0bcb9d139eccaed6b8f2f25960439f4a74
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5411b437fc3b4a04774902414441a20448b1b74e
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd60160e2a701d9effe831fb17976b564e1646e4
11/22/2024 01:41:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31d7d10e7e27ea859a6baf56bd4d2c7276a724c9
11/22/2024 01:41:39 PM UTC [INFO] Received an event for node: 674070e211fb139cb87e222c
11/22/2024 01:43:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:43761d307cf2e3346329885d87c7bc67b99d8c2b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070e211fb139cb87e222c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b1665d1ada6403538117296139561a56dbc0c328', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070e211fb139cb87e222c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:59553fece9c86d6b103089499a7eb6a70ac93ffd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bc5702aa3a5c04899509d4cbc55ce87b1d92f94b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dce', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1cf394a5412569f348d95d36c5782e0a02be2cb8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dcf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:af11abdf149c4a9dc61ff920e9b0468719d285a8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dcf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dd499f93e74b8b593d267220ee0ea4296d4c4448', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72fbf78d95182dab00c8a5b66ba573f36db30733', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bda412b5192eca5931319e53277a3e83de8ea4d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:902a241a1b499a019c0d07d7d221841fbf8371b7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:438c5ec92b7044b0917b5870c867ee2a61b9dfde', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a7d84f23c4e7f4186681e0b7b01d00c3010882e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:57b5aaa5857e5aabb2055249e402ac34bebe1247', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5ef6d9f12f62be2cd840db787d7390e1abab95a2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1ed85035da195271691e133f842ff249e7a6d978', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:83cf7aa84f1482783ff7d695117a6568cd82162e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0b35a85bedd971af992cd0e10b55b11111fbd5fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4babe33267c0355abff79e7615516e9d985eb626', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f7dbca549d588842bd5bd40a115a8d0c6852aacc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:98f40e6db69a16257a65448cf9bdb41d0050b6d0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c3fd7a24d588bf4a0a1c7d867b6609c13eecee7a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0d5321d3660dae2299dd07360d7c706fb664b42e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:01e502f6917e84b51589102f8be6ace021ca9a11', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:819a1919ce9cdcc72128d7c4dae963153b67b659', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0731d9d1594fa1784f82da1bcaf9f172e5872ed6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a35a6ebaa2feb44f1e2b8b5d837c5a97662f9bdd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dd9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6a81f26be1edfe79be068ef9b935fdc0ed4f94c7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dda', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf91ad98c5982143d419403ffa9272ec49ab90e0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dda', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bcc59b71192096a768a861cb35481c8fadcb0140', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e63f1aff791539ad4652f79141bf621730dd127f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7eba4a2df00cb3ecfbf1de7c1d2baed1fc7c27ff', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a31ecb34ae6a0d3f99c81ec2f44cddef06f9d5e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1c2d7710f5734d49bc39c9217da6cf38b4a74181', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3a3f4c4c553615d411139b50f9ce1fb65de1e7af', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f8f70f4408d8a19222cfd76d10c21f35d7cad5c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dde', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dbea4a81c228d509afbc6afa101e49a8e8ba47e5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dde', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:02c00f815aeecdb85c2c92a3387eb4d848767811', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7b9ab3a5022858fc9bdacecbad4c155afd17aebf', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ddf', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:efb2a2533d72cf77c87ea412ddbcefabd312d6da', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bc53cf142d3b6717a7c813569b2b157e5f5b50e6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7261a0db33d5ba0505a37639d570c4ad74672934', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:58af1a8dd4cd82dd17059cfeba514bb913b9adc7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4bdbba062838e7ff7121b337ce12b40534e2dc02', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2fd4ba162df0bf9174615dda21f8cc092bd6129a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2e938a4fdd72fb536d6ff53558a70017dff8b408', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:362fa91d014ee425cf774a6402f302d8a3a2569e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ba7cb4ca7400fc1d9b575bd3349a499a168e6173', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d48f25b25c0be100bcbb400176503e55c58bc499', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bf5eb0371e89a367563ea2d6570d3531ddea98ef', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4d0af41309fa145405874fefdc1e1658ca4927b2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:82a2be98075768fe6e0f4f93c7fa6bdeaeeacdbb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be287495382e884775ef4224789e0ef83de65e3a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:43588b71a6aeb3747e16fee2b8e4f0a638fa3af2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:570d72216c2044341ae1e6875558be1fb3799d89', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d3119e7aa71ae643e5b606a1ac325dfb4323f9c8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a1ec1b06269b089f5e992cb8330594c79d986c4d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:836415687bf480bce56ad978a500d3e404873011', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:196862c3d4751ddc81bd72c344d1355c2520f0f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2de9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bf0dfdb0dc71993557943d4aab13a1a4191f05ea', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:12028703012eaf14abae827de8397effa562dba7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dea', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3696e0950b853f1d4dfe2533b72241e65553bad5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2deb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ec08bd1eb81815cbbebdb848062aac375100c6dc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2deb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:16cc69f36ae8a3dd2338fe5e7bf2ea6faccb0964', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8a60369dd6453468421aeff3c221d6f21d044987', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fb5bb4afaa1ac23bb5f813e9f93308e9136ab8b2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ded', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:720e4248ac12754c3d04e1d95eccee7bd4cb2527', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ded', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a3178edd488d0bfec5409a01a87b78415abd7e4c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d4e43fe800e490ec863726b40c91db4fb55d9683', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:870a1af4d90fcb000ec0728a6fcb6cc44d156e4a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2def', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7d58a009300256e90f7bb03b296be7e269a6f5fa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2def', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:903bc497483bb7bcb471122a0a56454e2a63e208', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df5cabf66752285afb82c785a3b1a377d7394e0c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:25c3abf74ea9acee556030ee1d5186a5871dc9ca', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:546c99d2efd8beda94b9940b8ed28c9fefae892e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8e6fe524c45fc894c94ea7741df3b22a9168da1c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f77cacaa92c3a2129d178ba5779fd8db2165cfcd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a5ecbe4ddf8b410a28b81e3d24e313dee128cb0d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6b5b551bbb23cd5d684c8fa2ab99459d5fe6d8e5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fa16ceda8deffde8fe4aa611e50099fbfdde3d7d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7c43cf468491344031e67d7d6d8e0eb561a510bc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b343d097475ce30c2077c2a0a6ae95c78dcb6a8f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47ff308364f6d71f7310ac046b59bdb9c542f91b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dec5caa64bf6dc3105d06c70c35d2c1630943ab9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a63381d6563403c3bb6578270f0dce7a68cc3925', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:28626cc35b3b3c50684c23c15f489a40e1f56fb0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cd6d76e11fa43e4a57ba73eb47aa300da7d13f0e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:40 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:811d24e857fbbad81ae366cb46175bd052de43ab', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:134b1105fd97acaa01d7c9f70d0aafbd7662faa0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4b63c64d710ddd9a19c8b2ae24e5a7451b774d78', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c2feb7273ea7160cc8a6e170af6748b020a7515f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2df9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7cb8f229bf152ae071b9b42cfa56bc8d897d7eab', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:518358256ca7c46eea8e818a227709acf2122adb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfa', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:65864b223d5aed1ada10e5adfcb9ab2dc1803e2d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2f43bf1bce568bf1c419016c9c610cb7aa703ffe', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6a3e8302d546e4078325593138bcba5e04a02f63', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:47dca542c8cdaff4b22e53fcd27daec3246989ab', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfc', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:61ce0cb19f5b101d1a05419c60b2066ec000846f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f18baf7cb2bdbbd432a2f8b4a3d10856fa44ef28', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfd', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b4ccc2c3639b6486a52f869c920e099cbcbf8def', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:658e9ad9752685e89c60a4ab9d480fc306f72520', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dfe', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a96e0b9dee3a5edb01dad5ff215a1223192064d1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e93fe895f909e83650ef151144c04ca990a26d50', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2dff', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5a95e735eff92ce414f5394bca1c981b4a256ea2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a2401bbda64e3c65a1a95fdce7d3f8baa1eb55b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e00', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:43 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:239188070f927261c1015a71028e5432c7f3eebe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ceaf5590f2452f366f296c2478127910dab4490', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e01', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:55d72ab0fbbbb9050bd7fa8ccaaeeb426f37ce1f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:502bfcc4d112d11e0251cb58469b5e5c86df092b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e02', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6e5faec2501a6bcaa1a4dff594f4d160922f3beb', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:72e5c8182a96c4f312a7b36076741331de31f703', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e03', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:44 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7cfafc9ff189f603bad610d7eccaebdff3758eb7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:78079d7585bfdc85eacd397c0bee485ad3500cf5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e04', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5d63d6abc7bd190ae0583c831bf5cc52c9df328c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:83f7db8643a17f960d35b7b17d6e6692257488e3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e05', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c9d83fd05430acd23c8fe6ad5134cc4c80c53e95', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8a89cf76d5e117d08de252f37ca393e0a3224d45', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e06', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1572b05d1829612f90d229f2a3e5e5a093f50485', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3ee0fc292e190278dfffdda1300284d070ef919c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e07', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:45 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1d25e3747da9f00efa1fe8915e0b379c6dcc572f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b6af10aa23eca3f24d51d5662a676057cd817cd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8bffe50135166662062856561c56cf5f818f57b4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9a6e1e3e391f4cc3d79c72abca3c08d1a6d3d59f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e09', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:161464bc87e62342dee4cf5c8eb4dcd5ae371fbd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3b67dd248e92d8673911d759b5ce00261060d75', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b9fdd20f5599d8e0248cdbefc44b5d99f179efd6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8ba817d2a1a6d8529409d6c31457dda8797fcb5f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6de28fb448674d108c5797d215486d6d2cbfbf68', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:aa0c4b16d6f43765ceef2bc7f78ca721fe69924c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1de9953e2859e2f3a4b225d3eebdebe4a338e6be', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f069eb0aaef2c1c1002935e7696a7d5a83c274e4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7d572b5ca920121c0fb2acc943e0d985f7502ef3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:38696e04239a6023bbe3812f804a386040e7c523', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:328e3f34e317885217a7fba82222a55c1e850d75', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f3e24cfb2fb2f0c3779d663d818fc8019972a248', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e0f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:067d594a600293436bceff29eb9bfee04072d75b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:957730e5a7b8658e4576d6a1711d7d828cf28824', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e10', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3663766603039cbe41640275ea42a1e0308fafa4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29825330387162ce5f21fa2b467d490a7358144d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e11', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dc66a8f1fe0c0bb9f0da6504ad9833947e3003f6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:39d969063a35cd745340f48570407ee4996f63aa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e12', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:be6f35a9226e07fad159b0534f7f45d4ea3e1be4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bf227771b8b52ec6cc392dd93e0ea2c2330c9abb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e13', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d01b7fb507c54eede5425a5ef3dba4d9576f590f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4184afeec117b825e45c7ab398c891a5e451fa9a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e14', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:486fbfc8d5bf58c0c350b58f8a2f1c797064cb53', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c4add95a86b067529065687f51d7c232cb9cf93f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e15', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d994b41a575d7e7132dc39bd06ca4054879ab480', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a24552a128c59e783cf347d4b8a9aec7b7f0a21f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e16', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:50 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:866661957df0bbc97379889c8756a8e6afb16f1c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f1c0316d3520224b5e21adefc916e5534c17e32e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e17', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c0c0aa7c335c1d9633a9b7782c187a0fb0e5c8e1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3902f2a5e28b10142fda105d11ca4191b84f905a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e18', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b7b1d9fd21338dd61ddbc6b8bf7737e075952a0b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f86b0cd5afb4cf0bd5f0cd8138985c1c68f604b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e19', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d28d909acd53e0205d2f19a3553ce10192ed3928', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5975b0069505d988dbb923fd97753018f8e32ea1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:24ce7d8345877e4fb3bcf09b617d3bbe0f168b18', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:df2b365a7fd742b3196b9041c1edfb10fd857a68', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6b936c710ec771efdadf7c9071fbe3282d11178c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ab1e8341c4cc02dc11a7f8d6d6cf210e25544776', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:52 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c91a47f66e2c29ff7a3ad9dcbffbfa58e9e012d9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d7891aa46a9e72745db3f6524de6f7a101468892', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7ee9ca6b1355cb42bfa51986de56d4e333161786', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a96bb0cacd562f4a53d8204d83c47fa9dc4300d4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e8373e27dc986a007ee507d5912fdbc2242a5843', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:434f8f681463bdb7b8c5ab603e9f8ef0e2e35d78', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e1f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:53 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8d65184f6c90a97ba93a44341d81e5018ca76ef8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:abba3519ec8fb510b4be1318ebad118d380bf1b1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e20', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:05869590dfa8daa856f4db50f2279bdf7517eada', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b927127cb77c366e684c885ba115eb76592765f7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e21', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7d6709fdf0a91253b126100d4f5aa01877bee4e9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa80b7ee88817e4b227604f0e8273748e4bf6300', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e22', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:54 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d1708e2198c8b8ddeafa2e3001c786671e9eb4b6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a014ba256e2c7dad5ef11b322498229804a93c4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:93757ec248317d839e03f83ad04868ad6868fc07', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3c484d112e89a09a546284a2c6956e1dc469bb8f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ef31fce4ee7d14610f0249f39ae0ab36b35388d8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a6178b726bdb8812c7fd590e367a2496e8aa585', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e25', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:065fcb02cc14965f07f6b36065a7dc1ba2103377', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7361154f6fedd5409eb09b6493d9df905bf28249', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e26', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:55 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:68f20f6f28d909c3198a745fb3743396cd0a7cab', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:05ecae01bf77215da9942df407f46a25bc1ed086', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e27', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5bed25fd51d2aa8ea9834e45a921daf17774f78d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18e68df7325ef2515fbffefdf26895a82cdff9c6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e28', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:358f7063e17916ddbb9150f956cf5100eeb5ee0d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c5d92c004b0f199693a98235f1b0106087413824', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e29', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:de766685a013ce757b363977a2740acde7605027', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5c5443388f3d27943ef026d7668796e4cd0bcc3d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a0f486bda3414f14fa8634df9337c24ec5d87720', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:33ab6b398f20314b57490dc0f24e8578859a2859', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:863c1f03ed2e8f7ed2e21193402073c9c48a999c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:edc4ebf7fe4eab6c6e0f6021e85428e27507b6c6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:57 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5b40f106383bf159a0e6d3b6414336cd882ab842', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a66d841f8e05a513ba63512fcd3659c93e2f7a08', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7fe87fe2e2df04ab145391c7cdf390dbfe12ad88', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:843008c24587406c9f9b8de4015bf77a53cdfdbe', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9bb889f46d7364e21ac9948b1a17bd5f6afb5f22', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93524492d178e364e23377ff1cb2259fc61d352b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e2f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:58 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2f2e770652db31f89056216488c0010411355aba', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:65b462443c4bbe2436cbfbb49b46a5b28e7bd362', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:33984ba94f5c4928965c00f224501846cbcc2070', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1c7c7e77be9d177df30ad90d0535b1b6a8e32e29', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d183c93b0604f34e805cb7580b08cc723dc0f4fe', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:27022641d7e97936dd34ad6119709d2ef1080823', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e32', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:43:59 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:795fd527202b7f6fbb798155f95463eb149e2f51', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:37d5c7b6f7fbc10b8f98c8f10e6ef4099eb09b1c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e33', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:29ca8b661849fd2c5e4d955cc94433f9f3160a3e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1ad413d5d51d9de77a0d7ba9062fd938b3cb559f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e34', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3b980fe2f06d1d61baa1c9533242c567f67af1aa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:601adf81a4122eb9bb5964a87ab8790b5b750156', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e35', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:00 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4f5403c14b6d6daab9590d64d9b7223924e2d314', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9334e5ed35b672a2a88dfe9385973b07da767092', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e36', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:45a6ed20f2b2fe7eee283560d4e998990f574b89', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:82f70c0760917661679217b5603d06e7b6a0b626', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e37', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:be0cd505fcca74b8a5c546f22f23cf26995c6821', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7fb3d3293db2c5d2ede812198897c0dea617871b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a0f27914113fbec8e1d373f64f5b7360f571cb84', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68cff62a73daaa23f05ab9bd52b56b7af6d65395', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:935f2f75a38d3e3c649c8d7e6a22bbb90a1a371f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa5cf0edc90779431e97260bdc94c9fae2dc9b67', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:71d7b4bf433e69953d40c23c516729a7ad7d177b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:11039331439574bb2de4671e813f66078fb4bb0c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fdbc57922bdff4492ed9a75ff61534282ac9e6f5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:68c0a8eac8951e1f1c6174da90345c43ef734cff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8ed7bd6a2a473dc2420dbe13ba74bfed433bbe7e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4454966594145268955f972467888a18efec3e51', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4e65142d4df4d8c8315dabff3d77fa79411fda21', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:139d1332bf953f6bca00c90792c698af1046217e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c55ca55dd7bc52e0e077f70337d4ce1a6889c0e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:11eb9010fc5233ce909ac403e62d5f03bab294da', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e3f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:03 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:636e46f6acd6084eade8dcff6c7a8a52ea3e46ef', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:96ae77a5562405d51f3afe2de5644b62301df3f6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e40', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:71c828a65ad30490ff6350a2938ebab2fa1ff2df', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:70dbb4b1a1f2049a002b6b522ce7599855efc5ca', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e41', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4a44a12a2ae754f3c90dccc9879ebd5f18c505ba', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4409aee05651eefdf6223df7a44841c6f1fbf4df', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e42', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:04 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:44143d7c6f79d71fc745156bcec0cf63689dabbc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:16de1b7cefb5e5068deaf924c0ed2f513c449fd3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e43', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:aae555a8e58b43ad5353557c32f1fa82cdc88ecd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5f7a4d216678917c118ed0edcc8be1a39d20498d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e44', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bb8a6c7621cd0b16dd59ea8da94608390c69ac63', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:985c068878d11e9149f41028443002248bbe070d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e45', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:05 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:dc4edbb15791f941166ac7075f07fd09a2423772', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:39aba28815b41321afd0ecc2ae50b4c1b0820865', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e46', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f698ddf5d8ad9c8822a9f7a8daaaa62eb1f40aa4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:87dbc7508e20bcc77f7393be09ec6f81616f85d9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e47', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:50f828c47e6dbf7723099491cbdb8977a063a85f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cd4bad57f71562dd2e7b8a673d8df9f61c41c931', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e48', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:06 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee0f205dc90b949fdb9952eaae1260a05d337402', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8509257f19e16ab00c08eed84f87ec98069afc34', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e49', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b7019542b2aed4e2aafba70f3d0d705ac8d268c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:52359461559c7c32b330652340b5afa372b2af40', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:8a9edda3b64f87f00fa838acef61e3e84fd7eca5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:493bc533dd7ccdc370dcab4e3a7d60eb59e3e707', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:07 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7109512524f523cd50b2de06af68348ca74dc12e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:451f1765093354cde3e5d8f1388a2db9ac220de9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:617317b479e896c6297e069c1bc14d0a73ef86dc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b6d46976b155a838e96b7dcd189aeab103cdc1a0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ce0fa07c002b89aebaad3fc7e985a4c73ef00ab9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6a680dc41b18a737de181e234e2dba275da24141', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:af0820034c5d244ecb0ba31ce54f6dfc407767b1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:56f1c3f5d8a314352aa535f7701106174a14a3ae', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e4f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:50a7a29b0dd566f4dc15ccc565ff1e8354f90535', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:958fd2dd854bb85d7d8c8c1133548f444f4d9f3e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e50', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:094d970094717d41a0ab8ee4f0294699fdf20480', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc1d71e709675c09bec1cd1951b7d9a7ff3e28e6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e51', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:09 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:affd2fe866960972150c7e250d5f87d897880ef8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:594e0ef69783a38a2b12255b1ff346a0bb399673', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4ca36070826ae39b1d40d6771a0ed4f52091d2fa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9df9c094f21adba82d8ba6c8375333a9bffac0c1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e53', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ec1e0abcbae0226552f034ef2103884303528130', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ffc72a12c64ee60c4c84eaf16ef1a7870e3611a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e54', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:10 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bac8203ed9e20ac20fcc5dd18565b28c56799d63', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a3f08720350c6fb6a16271461f45a45ee5b2261', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e55', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:895593658c357ea652d668ba8f682456e1a93c92', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9691658d1e39ef1352e7406f5e38e891ebc23f1e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e56', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d99a9febc627f8ec631426f09b6fc3310006304a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:48acdd93fd0ed2f4e9f3f5b888bd66f6c52e41cd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e57', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:11 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e5f6d5617c73c0ffd9d6d1028bf86c5b679f825c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0adb2e4b88c7e3f5bed22b686ed315319b2b011a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e58', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:78a3c44e1c6711a603e92370cfeaba02a1e938e0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc31c37b9ed03ddcf3cbab6b01d93ac4d81090ec', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e59', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:86ac2effa18f260725d4de3864c405fb4b710b4d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57a79bb853c0dc26968e1e12d4da3d9cf2c1c5bc', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:51892c174fc10734d26943c0c4e1fcfc516c5cb5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:063ae19ed3c95c9068b8566d2ac83b032f14eae9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5a1fa09a39a931a48741f632155f2859f1e4e1b0', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7b2584d06b2d978e9195d74ed632d17304ff49e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:84dd3de656d20a0956f33e78bd80d9726fd51a05', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2422ca4210b73182eccac8be575161f62a2903ca', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:49f882d0e641bc9f72df8abac26bdd766cda50cf', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7d86797f1b6242bc51e6974130fabed65a71440e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f02809910a036dc7a7585fcfeb813332a6f260af', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9b7fc16cd120391dff388c2acedbf31544f7e9e6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e5f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c67489ab363319064fc8ef96dab900d2b378e5aa', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:79bdb549e437419ecb5710252c1ab432fd95402a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e60', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:095b130731eee6c213cc72930f7e4bfaf860d6c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3a476213e8e905492584227360e5ba1a098abc8a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fc10c81a77d35cb43811a779146788bbdf56633f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2400bd7db0ca250b222bca975671c85475cd16c4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e62', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:de5486b67096d72be18ce2911c4fa9eed9aecda8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:23bc8e731e4de12ef672ef4d728c76e3753c3458', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e63', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:04ba2f8e19acbff86b5b61823c818cb5676fa25f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f48adeb817e008f90886499a93d7ea9265bb5343', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e64', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cdfdac8f9e4349e08a3c7c406d5f7e5e988384e2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:683241403d9b38ada5dac58fa5e8408eadf5ab78', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e65', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7cb4916670b27349780731d7622c1c22d5963560', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d5eee05befd45786d1c9eb5a2fbe2db6bc4a9f3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e66', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:16 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:fb99bb25e16dcfb277084f0a6daa4c0d3c9019c2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e78148ca81fd41a7b39f46d25d12911f0a331938', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e67', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a273bc4e7b1a511cc68ea07a0787cfbaa08c3b7e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5fb6ce55f24604cf21f962db64cc69b364ebc5d4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e68', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:53d4b871f85e24bc4cce02debcce63a86e2521ce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:84d52396a70e60c723bf79f703737cfcd8962b30', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e69', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c23201907940957f21bd2ded7e92e02583066f34', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:db53dd212030492675f17185a12c79e8961c8f0a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1e39b60056e30dfc93e7042becbee9a27f57c1b3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dcee2d5d2c80bc30445eae87026486504190368d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:78bb3f94cfb297ce7aecde656ffceb71fe19f375', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2aea43dbad74b62200d0b00f49227721e5b1e6d7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:18 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:06833bcaffb65e8d01df2ea279d1b82877d7e8c2', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5152daad9225ab73bfea35b5b1721c4cf027ae4e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e34095d1c75e15acdcb4911599e987987ebce9c8', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7dae74c51b6690c25c7e8ddad0850094f75d634a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5fb4c23d39af65333758a3e64b972592c7ec3f37', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6528d4eca1ffe5cce9f25e0b7f522317ee9257e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e6f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:19 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7d4a2acd4e5535469dda796d4d100b57e73ec0b7', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a90fff158d0a2397ef9d8e559d563a77e2c3704', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:99256a351d591205542ca167e65fcc10e118e95e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a1c0f523195b66d59ed79d9a31b91721088b6ee', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e71', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:15846f2c018e581b389fdf2bbe7b4506e167800d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:13e83b0b7daeed1de5a16be224d3b9fbdc323cf3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e72', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1b84c74a88f1e4527aba8a2600d22e925bd022d6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4cfada0e631a6760541c540ff339412a4ccf8297', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3c0f7307be815e8c8ee1ba195f4375a60e7cef15', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b7946e933994f5b196877a36df9caf702843bfe7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e74', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2abf2a389454d8dec22ec51b115bdbadead86142', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1af523e9665edb9099eb95694d21510e542c656e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e75', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:94b43d647a9283ce67fe81ca436e094284c12047', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bff86ef338baa34612c49ea6edad81d543fb1ab4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e76', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:21 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ed199ce55b1436e8df55722a4c3074167afe281c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0164c92733ea4acd6b5eea33d4b5898367d48383', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e77', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:04eced2228d03d07e69bf6cdc4d6059113ada27b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:dd505aceb5e690e5e4927cb1d32b28dd3e6e7cbe', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e78', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:90566eabc493bd329e4b5cf9725ffed0a288c027', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7e0e72b5913d5d4444b1ebf864e4d1fcf8b9e054', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e79', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:22 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e7427c2d871477d84f6ebe35229de834c7f3063e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4cc284f04fdc64445e78f9b727d7a79126fecfbb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f072279edc340886ca4e0b201faf760b65cbd445', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a005f2d883be5f3872ffff68dce471c3a92f9553', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:581810bede83203f85e1376cc1b12b298d963670', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0cb9d763af83c053e706dcd182d6751b8026c81e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:23 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:057823f9e7257642db0bd50d59fe3759727f8f61', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5f4e7bea66a245383d712b10ac1e45e61cae0fde', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d1ebe3dadca38b69f52c52fb1503294bb59021af', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:831c96f7a7995567173b5020451b7f325a89cb0e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c2ac6da7827ddc1caf42707f962eaf329d9c3f4c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9c2af2cc479c303148dc37009366f2a68bb11967', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e7f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:24 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:5736d2cdfa063a674fa1b1d1e475452f806c4a93', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:24f253bae12653b2301aeb0fb60660d75387b7e1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e80', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:c805cfc28e732f882d071465f2cc786eac8b664b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:9257d69120354f65e361b4d3c9fd56f32f8d6a64', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e81', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:002ce12f05eb06650214af0bff53c69f69b09d3b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:bf41d333d4d19299a752cdb96c87688eb9fc0efa', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:30a16111d03026ff6f1b034508a6834ebb8d6679', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e708f0c3e17db16be2d534bffecad9de8ede8a15', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e83', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:490a517964cefdc3785dc7388892e831ad7cdfbc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f8a75eb1241ca03de7a67eb1dd75aabe77f5f50b', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:cf9b9bff8f999177cef6008f6e043d631bcad907', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93271dbfa00121da75f94d8c135205c0e1c6d3f4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:27ba42c39cb840a422d836086e6ec39281a77790', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:507ef9fb27aed0f13d3d5be781af969bd804fd5e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e86', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:706760d4d629af8dd4673515b2fceb3d24888664', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5cc262c20f37c0d7489f79511c4245153c445748', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e87', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a29f51d681e7b5538c445440d3ab150f4266d573', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5e9d6b36de1403f71ee9096a8d507a6663792c90', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:24e729705e5a2a2c92b43af76b5defdd18f8f914', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:19227b41bfef752ed9cbe875e8db2a36ee3c46b7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e89', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d991f5d0963f638d12b8e56366a046e18ce29481', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:34ed3b4eb90a94006ddca2df8a4de5613224df80', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1b4f77a13e483a8c3f5ce0bf267a431fac8eac1b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a0d08cc4daf8562488dc66f807b16586aa6ab7a4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:28 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e61f9eaa1eeeb64945d95bb6171bea8ffda74811', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2a7c5dab46aa6e249d7cd3c146e013050adf9db3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:35141b690622485206cf9838e092d20709fdbe9c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:86032ef226a7f5b922df904cebbd537c6c1cd4a3', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ab506f02be882b694f8640c737842ef12ec8b125', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3f9c5dc598c64daba39ab22321e2163f17a4a64a', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:29 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a7e0d5bee713a0bec9a1ab828641ce7f981a6f28', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b5b405a917cf179b78f09e6191eebdcf790b0845', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e8f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6ba2701b66722da3e09a4a50f951066e66335b79', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:563a9ce64b1665bd183b1c61b9c0e6ccc8d1ae16', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e90', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:448ce8bcdb20480e23951740b6d5888228ac5ece', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d9ceb8020295410e28f4fba84dd9f9da0c9f76b0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e91', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:30 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:140610db888c0e17cd8fddf87d6a337534051ea1', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5a9e5925bc2135be57faf3eb09e7ce5f5985219', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e92', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:96725cfd93dab90aa87279dd89955720bfab3e5f', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ae1cbab0071b8f68246d1234a31789466abe7cac', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e93', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:282738a0978ad718919f11d141f7ed28cf8bf00b', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:64997bbaccf8f0c6b3c11b2ac102a544749c3b3e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e94', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:1dc4a198bef5ae8e87e2a9c7917f5a18a8e87524', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6b139d8923ca57a89476e69c7e69623f3d027c17', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e95', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:a3729a07682d75b6b6b5468717ba78ab76a40cd5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5a30d699817028d587703e9c4a0848d5988030a5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e96', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:32 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:12e9dc010efac0e440dee70fece9366c10dab38a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5bcb684c65b1faf156c940b3bf085c23950965eb', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e97', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ce5a6900fa5bb8a27717098dcc277e4411f114b6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4a2c50d8f8377e048ddd1c8d68877d07d836e8d2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e98', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:41bf1c6cea7fb8915058a1bf6b1bb45c3a9dc378', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d5f56265f022d57ecfcffc11e89527c84464f4a9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e99', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:512e622846a5faa808b5716dde22f77753798a37', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:46dc1bc9ee1809b763b6994ba2c67ca74163bb0e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b49085f6ef2c7596f414e6d3711c3cf1db59e72e', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:3edd5162266daec99a82fd5a37e63a7218797cb1', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:176a3a0d95781d440312c85f4e12bc11f9871bf6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b30571a9fab3bdb198682275806b88527e1f8904', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b050e2833d4a1c0500e8c39f03f80e8126fe396d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:be4fed4d0e1f2347f43360e56dcea08546243748', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:6ef1fb4e7f4a6cbed12582978a5af78c886c1ba5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:93ca41f376ed191171f05b30f80395a6c31fcad7', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bc0695cfc279d86076c1cfe01bf96d1e4b30dbc9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:acfeacad7477e0d4415d62406a0de43fc9ccd8a6', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2e9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:154c841685ca9da73d846afb395e2fa303086062', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c4cbe7f12760f32031317535631679234da08848', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ddfb5c7202572dfe13950503c1a92575a15345a9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1a279a00aa1c1e56dcd80734d0e5a5e16a4531f5', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea1', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:36 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ebfaffccd78ccf303849963fffaccf051b739481', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:8df70fa20786aadec9802042dfe6faaff13f8531', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54163b0159ffae7505f6ad129a17a3bb93f330ee', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a4e64c0931d241e532e4fd19b0a042338224b7e2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:d7d2bd352292f23b4045e581d40ec098d53e91ba', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cfa6f05d59d74e3c309f12da1324bf4845fdc7bd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea4', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:37 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f6274e06c23a07b4fee8c5839c27e37a7a8f33ce', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c75c347b1bc805a14aac4c1eea55cc61c8b49d4d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea5', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b615c0ead4253e6f7a41fa1549894a51546c8dd3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:163856c26ca18f99b7e3871c036421ee80796474', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:38 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9039e70513ba52765118b3533a73e931889cdcba', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c4f1be6c93c4ade6d70231b7904224f7e96e3086', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740745711fb139cb87e2ea7', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e211fb139cb87e222c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dc5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dc6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dc7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dc8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dc9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dca
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dcb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dcc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dcd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dce
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dcf
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dd9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dda
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ddb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ddc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ddd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dde
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ddf
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2de9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dea
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2deb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dec
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ded
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dee
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2def
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2df9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dfa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dfb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dfc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dfd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dfe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2dff
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e00
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e01
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e02
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e03
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e04
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e05
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e06
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e07
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e08
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e09
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e0f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e10
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e11
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e12
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e13
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e14
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e15
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e16
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e17
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e18
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e19
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e1f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e20
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e21
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e22
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e23
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e24
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e25
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e26
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e27
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e28
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e29
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e2f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e30
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e31
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e32
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e33
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e34
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e35
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e36
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e37
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e38
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e39
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e3f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e40
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e41
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e42
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e43
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e44
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e45
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e46
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e47
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e48
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e49
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e4f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e50
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e51
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e52
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e53
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e54
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e55
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e56
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e57
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e58
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e59
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e5f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e60
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e61
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e62
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e63
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e64
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e65
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e66
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e67
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e68
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e69
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e6f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e70
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e71
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e72
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e73
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e74
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e75
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e76
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e77
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e78
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e79
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e7f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e80
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e81
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e82
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e83
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e84
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e85
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e86
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e87
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e88
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e89
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e8f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e90
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e91
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e92
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e93
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e94
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e95
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e96
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e97
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e98
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e99
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2e9f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740745711fb139cb87e2ea8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:43761d307cf2e3346329885d87c7bc67b99d8c2b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b1665d1ada6403538117296139561a56dbc0c328
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:59553fece9c86d6b103089499a7eb6a70ac93ffd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc5702aa3a5c04899509d4cbc55ce87b1d92f94b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1cf394a5412569f348d95d36c5782e0a02be2cb8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af11abdf149c4a9dc61ff920e9b0468719d285a8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd499f93e74b8b593d267220ee0ea4296d4c4448
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72fbf78d95182dab00c8a5b66ba573f36db30733
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bda412b5192eca5931319e53277a3e83de8ea4d5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:902a241a1b499a019c0d07d7d221841fbf8371b7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:438c5ec92b7044b0917b5870c867ee2a61b9dfde
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a7d84f23c4e7f4186681e0b7b01d00c3010882e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57b5aaa5857e5aabb2055249e402ac34bebe1247
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5ef6d9f12f62be2cd840db787d7390e1abab95a2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ed85035da195271691e133f842ff249e7a6d978
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83cf7aa84f1482783ff7d695117a6568cd82162e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0b35a85bedd971af992cd0e10b55b11111fbd5fa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4babe33267c0355abff79e7615516e9d985eb626
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f7dbca549d588842bd5bd40a115a8d0c6852aacc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:98f40e6db69a16257a65448cf9bdb41d0050b6d0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3fd7a24d588bf4a0a1c7d867b6609c13eecee7a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0d5321d3660dae2299dd07360d7c706fb664b42e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:01e502f6917e84b51589102f8be6ace021ca9a11
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:819a1919ce9cdcc72128d7c4dae963153b67b659
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0731d9d1594fa1784f82da1bcaf9f172e5872ed6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a35a6ebaa2feb44f1e2b8b5d837c5a97662f9bdd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a81f26be1edfe79be068ef9b935fdc0ed4f94c7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf91ad98c5982143d419403ffa9272ec49ab90e0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bcc59b71192096a768a861cb35481c8fadcb0140
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e63f1aff791539ad4652f79141bf621730dd127f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7eba4a2df00cb3ecfbf1de7c1d2baed1fc7c27ff
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a31ecb34ae6a0d3f99c81ec2f44cddef06f9d5e2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c2d7710f5734d49bc39c9217da6cf38b4a74181
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a3f4c4c553615d411139b50f9ce1fb65de1e7af
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f8f70f4408d8a19222cfd76d10c21f35d7cad5c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dbea4a81c228d509afbc6afa101e49a8e8ba47e5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:02c00f815aeecdb85c2c92a3387eb4d848767811
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b9ab3a5022858fc9bdacecbad4c155afd17aebf
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:efb2a2533d72cf77c87ea412ddbcefabd312d6da
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc53cf142d3b6717a7c813569b2b157e5f5b50e6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7261a0db33d5ba0505a37639d570c4ad74672934
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:58af1a8dd4cd82dd17059cfeba514bb913b9adc7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4bdbba062838e7ff7121b337ce12b40534e2dc02
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2fd4ba162df0bf9174615dda21f8cc092bd6129a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2e938a4fdd72fb536d6ff53558a70017dff8b408
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:362fa91d014ee425cf774a6402f302d8a3a2569e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ba7cb4ca7400fc1d9b575bd3349a499a168e6173
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d48f25b25c0be100bcbb400176503e55c58bc499
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bf5eb0371e89a367563ea2d6570d3531ddea98ef
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4d0af41309fa145405874fefdc1e1658ca4927b2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82a2be98075768fe6e0f4f93c7fa6bdeaeeacdbb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be287495382e884775ef4224789e0ef83de65e3a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:43588b71a6aeb3747e16fee2b8e4f0a638fa3af2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:570d72216c2044341ae1e6875558be1fb3799d89
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d3119e7aa71ae643e5b606a1ac325dfb4323f9c8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a1ec1b06269b089f5e992cb8330594c79d986c4d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:836415687bf480bce56ad978a500d3e404873011
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:196862c3d4751ddc81bd72c344d1355c2520f0f6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bf0dfdb0dc71993557943d4aab13a1a4191f05ea
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12028703012eaf14abae827de8397effa562dba7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3696e0950b853f1d4dfe2533b72241e65553bad5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec08bd1eb81815cbbebdb848062aac375100c6dc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16cc69f36ae8a3dd2338fe5e7bf2ea6faccb0964
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a60369dd6453468421aeff3c221d6f21d044987
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb5bb4afaa1ac23bb5f813e9f93308e9136ab8b2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:720e4248ac12754c3d04e1d95eccee7bd4cb2527
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3178edd488d0bfec5409a01a87b78415abd7e4c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d4e43fe800e490ec863726b40c91db4fb55d9683
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:870a1af4d90fcb000ec0728a6fcb6cc44d156e4a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d58a009300256e90f7bb03b296be7e269a6f5fa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:903bc497483bb7bcb471122a0a56454e2a63e208
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df5cabf66752285afb82c785a3b1a377d7394e0c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:25c3abf74ea9acee556030ee1d5186a5871dc9ca
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:546c99d2efd8beda94b9940b8ed28c9fefae892e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8e6fe524c45fc894c94ea7741df3b22a9168da1c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f77cacaa92c3a2129d178ba5779fd8db2165cfcd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5ecbe4ddf8b410a28b81e3d24e313dee128cb0d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b5b551bbb23cd5d684c8fa2ab99459d5fe6d8e5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa16ceda8deffde8fe4aa611e50099fbfdde3d7d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7c43cf468491344031e67d7d6d8e0eb561a510bc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b343d097475ce30c2077c2a0a6ae95c78dcb6a8f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47ff308364f6d71f7310ac046b59bdb9c542f91b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dec5caa64bf6dc3105d06c70c35d2c1630943ab9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a63381d6563403c3bb6578270f0dce7a68cc3925
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:28626cc35b3b3c50684c23c15f489a40e1f56fb0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cd6d76e11fa43e4a57ba73eb47aa300da7d13f0e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:811d24e857fbbad81ae366cb46175bd052de43ab
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:134b1105fd97acaa01d7c9f70d0aafbd7662faa0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b63c64d710ddd9a19c8b2ae24e5a7451b774d78
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2feb7273ea7160cc8a6e170af6748b020a7515f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cb8f229bf152ae071b9b42cfa56bc8d897d7eab
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:518358256ca7c46eea8e818a227709acf2122adb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65864b223d5aed1ada10e5adfcb9ab2dc1803e2d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f43bf1bce568bf1c419016c9c610cb7aa703ffe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a3e8302d546e4078325593138bcba5e04a02f63
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:47dca542c8cdaff4b22e53fcd27daec3246989ab
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:61ce0cb19f5b101d1a05419c60b2066ec000846f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f18baf7cb2bdbbd432a2f8b4a3d10856fa44ef28
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b4ccc2c3639b6486a52f869c920e099cbcbf8def
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:658e9ad9752685e89c60a4ab9d480fc306f72520
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a96e0b9dee3a5edb01dad5ff215a1223192064d1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e93fe895f909e83650ef151144c04ca990a26d50
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a95e735eff92ce414f5394bca1c981b4a256ea2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a2401bbda64e3c65a1a95fdce7d3f8baa1eb55b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:239188070f927261c1015a71028e5432c7f3eebe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ceaf5590f2452f366f296c2478127910dab4490
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:55d72ab0fbbbb9050bd7fa8ccaaeeb426f37ce1f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:502bfcc4d112d11e0251cb58469b5e5c86df092b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6e5faec2501a6bcaa1a4dff594f4d160922f3beb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:72e5c8182a96c4f312a7b36076741331de31f703
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cfafc9ff189f603bad610d7eccaebdff3758eb7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78079d7585bfdc85eacd397c0bee485ad3500cf5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d63d6abc7bd190ae0583c831bf5cc52c9df328c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:83f7db8643a17f960d35b7b17d6e6692257488e3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c9d83fd05430acd23c8fe6ad5134cc4c80c53e95
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a89cf76d5e117d08de252f37ca393e0a3224d45
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1572b05d1829612f90d229f2a3e5e5a093f50485
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3ee0fc292e190278dfffdda1300284d070ef919c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1d25e3747da9f00efa1fe8915e0b379c6dcc572f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b6af10aa23eca3f24d51d5662a676057cd817cd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8bffe50135166662062856561c56cf5f818f57b4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9a6e1e3e391f4cc3d79c72abca3c08d1a6d3d59f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:161464bc87e62342dee4cf5c8eb4dcd5ae371fbd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3b67dd248e92d8673911d759b5ce00261060d75
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b9fdd20f5599d8e0248cdbefc44b5d99f179efd6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ba817d2a1a6d8529409d6c31457dda8797fcb5f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6de28fb448674d108c5797d215486d6d2cbfbf68
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aa0c4b16d6f43765ceef2bc7f78ca721fe69924c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1de9953e2859e2f3a4b225d3eebdebe4a338e6be
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f069eb0aaef2c1c1002935e7696a7d5a83c274e4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d572b5ca920121c0fb2acc943e0d985f7502ef3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:38696e04239a6023bbe3812f804a386040e7c523
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:328e3f34e317885217a7fba82222a55c1e850d75
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f3e24cfb2fb2f0c3779d663d818fc8019972a248
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:067d594a600293436bceff29eb9bfee04072d75b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:957730e5a7b8658e4576d6a1711d7d828cf28824
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3663766603039cbe41640275ea42a1e0308fafa4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29825330387162ce5f21fa2b467d490a7358144d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc66a8f1fe0c0bb9f0da6504ad9833947e3003f6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39d969063a35cd745340f48570407ee4996f63aa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be6f35a9226e07fad159b0534f7f45d4ea3e1be4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bf227771b8b52ec6cc392dd93e0ea2c2330c9abb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d01b7fb507c54eede5425a5ef3dba4d9576f590f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4184afeec117b825e45c7ab398c891a5e451fa9a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:486fbfc8d5bf58c0c350b58f8a2f1c797064cb53
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4add95a86b067529065687f51d7c232cb9cf93f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d994b41a575d7e7132dc39bd06ca4054879ab480
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a24552a128c59e783cf347d4b8a9aec7b7f0a21f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:866661957df0bbc97379889c8756a8e6afb16f1c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1c0316d3520224b5e21adefc916e5534c17e32e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0c0aa7c335c1d9633a9b7782c187a0fb0e5c8e1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3902f2a5e28b10142fda105d11ca4191b84f905a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7b1d9fd21338dd61ddbc6b8bf7737e075952a0b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f86b0cd5afb4cf0bd5f0cd8138985c1c68f604b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d28d909acd53e0205d2f19a3553ce10192ed3928
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5975b0069505d988dbb923fd97753018f8e32ea1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24ce7d8345877e4fb3bcf09b617d3bbe0f168b18
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df2b365a7fd742b3196b9041c1edfb10fd857a68
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b936c710ec771efdadf7c9071fbe3282d11178c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab1e8341c4cc02dc11a7f8d6d6cf210e25544776
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c91a47f66e2c29ff7a3ad9dcbffbfa58e9e012d9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7891aa46a9e72745db3f6524de6f7a101468892
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7ee9ca6b1355cb42bfa51986de56d4e333161786
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a96bb0cacd562f4a53d8204d83c47fa9dc4300d4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e8373e27dc986a007ee507d5912fdbc2242a5843
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:434f8f681463bdb7b8c5ab603e9f8ef0e2e35d78
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8d65184f6c90a97ba93a44341d81e5018ca76ef8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:abba3519ec8fb510b4be1318ebad118d380bf1b1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05869590dfa8daa856f4db50f2279bdf7517eada
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b927127cb77c366e684c885ba115eb76592765f7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d6709fdf0a91253b126100d4f5aa01877bee4e9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa80b7ee88817e4b227604f0e8273748e4bf6300
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1708e2198c8b8ddeafa2e3001c786671e9eb4b6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a014ba256e2c7dad5ef11b322498229804a93c4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93757ec248317d839e03f83ad04868ad6868fc07
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c484d112e89a09a546284a2c6956e1dc469bb8f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ef31fce4ee7d14610f0249f39ae0ab36b35388d8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a6178b726bdb8812c7fd590e367a2496e8aa585
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:065fcb02cc14965f07f6b36065a7dc1ba2103377
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7361154f6fedd5409eb09b6493d9df905bf28249
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68f20f6f28d909c3198a745fb3743396cd0a7cab
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05ecae01bf77215da9942df407f46a25bc1ed086
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5bed25fd51d2aa8ea9834e45a921daf17774f78d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18e68df7325ef2515fbffefdf26895a82cdff9c6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:358f7063e17916ddbb9150f956cf5100eeb5ee0d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c5d92c004b0f199693a98235f1b0106087413824
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de766685a013ce757b363977a2740acde7605027
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5c5443388f3d27943ef026d7668796e4cd0bcc3d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0f486bda3414f14fa8634df9337c24ec5d87720
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33ab6b398f20314b57490dc0f24e8578859a2859
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:863c1f03ed2e8f7ed2e21193402073c9c48a999c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:edc4ebf7fe4eab6c6e0f6021e85428e27507b6c6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5b40f106383bf159a0e6d3b6414336cd882ab842
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a66d841f8e05a513ba63512fcd3659c93e2f7a08
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fe87fe2e2df04ab145391c7cdf390dbfe12ad88
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:843008c24587406c9f9b8de4015bf77a53cdfdbe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9bb889f46d7364e21ac9948b1a17bd5f6afb5f22
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93524492d178e364e23377ff1cb2259fc61d352b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2f2e770652db31f89056216488c0010411355aba
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:65b462443c4bbe2436cbfbb49b46a5b28e7bd362
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:33984ba94f5c4928965c00f224501846cbcc2070
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c7c7e77be9d177df30ad90d0535b1b6a8e32e29
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d183c93b0604f34e805cb7580b08cc723dc0f4fe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27022641d7e97936dd34ad6119709d2ef1080823
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:795fd527202b7f6fbb798155f95463eb149e2f51
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:37d5c7b6f7fbc10b8f98c8f10e6ef4099eb09b1c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29ca8b661849fd2c5e4d955cc94433f9f3160a3e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1ad413d5d51d9de77a0d7ba9062fd938b3cb559f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3b980fe2f06d1d61baa1c9533242c567f67af1aa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:601adf81a4122eb9bb5964a87ab8790b5b750156
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4f5403c14b6d6daab9590d64d9b7223924e2d314
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9334e5ed35b672a2a88dfe9385973b07da767092
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:45a6ed20f2b2fe7eee283560d4e998990f574b89
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:82f70c0760917661679217b5603d06e7b6a0b626
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be0cd505fcca74b8a5c546f22f23cf26995c6821
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7fb3d3293db2c5d2ede812198897c0dea617871b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0f27914113fbec8e1d373f64f5b7360f571cb84
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68cff62a73daaa23f05ab9bd52b56b7af6d65395
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:935f2f75a38d3e3c649c8d7e6a22bbb90a1a371f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa5cf0edc90779431e97260bdc94c9fae2dc9b67
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71d7b4bf433e69953d40c23c516729a7ad7d177b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11039331439574bb2de4671e813f66078fb4bb0c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fdbc57922bdff4492ed9a75ff61534282ac9e6f5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:68c0a8eac8951e1f1c6174da90345c43ef734cff
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8ed7bd6a2a473dc2420dbe13ba74bfed433bbe7e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4454966594145268955f972467888a18efec3e51
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4e65142d4df4d8c8315dabff3d77fa79411fda21
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:139d1332bf953f6bca00c90792c698af1046217e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c55ca55dd7bc52e0e077f70337d4ce1a6889c0e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:11eb9010fc5233ce909ac403e62d5f03bab294da
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:636e46f6acd6084eade8dcff6c7a8a52ea3e46ef
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:96ae77a5562405d51f3afe2de5644b62301df3f6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:71c828a65ad30490ff6350a2938ebab2fa1ff2df
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:70dbb4b1a1f2049a002b6b522ce7599855efc5ca
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a44a12a2ae754f3c90dccc9879ebd5f18c505ba
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4409aee05651eefdf6223df7a44841c6f1fbf4df
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:44143d7c6f79d71fc745156bcec0cf63689dabbc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:16de1b7cefb5e5068deaf924c0ed2f513c449fd3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:aae555a8e58b43ad5353557c32f1fa82cdc88ecd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f7a4d216678917c118ed0edcc8be1a39d20498d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb8a6c7621cd0b16dd59ea8da94608390c69ac63
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:985c068878d11e9149f41028443002248bbe070d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dc4edbb15791f941166ac7075f07fd09a2423772
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:39aba28815b41321afd0ecc2ae50b4c1b0820865
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f698ddf5d8ad9c8822a9f7a8daaaa62eb1f40aa4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:87dbc7508e20bcc77f7393be09ec6f81616f85d9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:50f828c47e6dbf7723099491cbdb8977a063a85f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cd4bad57f71562dd2e7b8a673d8df9f61c41c931
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee0f205dc90b949fdb9952eaae1260a05d337402
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8509257f19e16ab00c08eed84f87ec98069afc34
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7019542b2aed4e2aafba70f3d0d705ac8d268c6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:52359461559c7c32b330652340b5afa372b2af40
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8a9edda3b64f87f00fa838acef61e3e84fd7eca5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:493bc533dd7ccdc370dcab4e3a7d60eb59e3e707
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7109512524f523cd50b2de06af68348ca74dc12e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:451f1765093354cde3e5d8f1388a2db9ac220de9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:617317b479e896c6297e069c1bc14d0a73ef86dc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b6d46976b155a838e96b7dcd189aeab103cdc1a0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce0fa07c002b89aebaad3fc7e985a4c73ef00ab9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6a680dc41b18a737de181e234e2dba275da24141
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:af0820034c5d244ecb0ba31ce54f6dfc407767b1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:56f1c3f5d8a314352aa535f7701106174a14a3ae
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:50a7a29b0dd566f4dc15ccc565ff1e8354f90535
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:958fd2dd854bb85d7d8c8c1133548f444f4d9f3e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:094d970094717d41a0ab8ee4f0294699fdf20480
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc1d71e709675c09bec1cd1951b7d9a7ff3e28e6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:affd2fe866960972150c7e250d5f87d897880ef8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:594e0ef69783a38a2b12255b1ff346a0bb399673
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4ca36070826ae39b1d40d6771a0ed4f52091d2fa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9df9c094f21adba82d8ba6c8375333a9bffac0c1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec1e0abcbae0226552f034ef2103884303528130
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ffc72a12c64ee60c4c84eaf16ef1a7870e3611a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bac8203ed9e20ac20fcc5dd18565b28c56799d63
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a3f08720350c6fb6a16271461f45a45ee5b2261
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:895593658c357ea652d668ba8f682456e1a93c92
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9691658d1e39ef1352e7406f5e38e891ebc23f1e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d99a9febc627f8ec631426f09b6fc3310006304a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:48acdd93fd0ed2f4e9f3f5b888bd66f6c52e41cd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e5f6d5617c73c0ffd9d6d1028bf86c5b679f825c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0adb2e4b88c7e3f5bed22b686ed315319b2b011a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78a3c44e1c6711a603e92370cfeaba02a1e938e0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc31c37b9ed03ddcf3cbab6b01d93ac4d81090ec
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86ac2effa18f260725d4de3864c405fb4b710b4d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57a79bb853c0dc26968e1e12d4da3d9cf2c1c5bc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:51892c174fc10734d26943c0c4e1fcfc516c5cb5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:063ae19ed3c95c9068b8566d2ac83b032f14eae9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a1fa09a39a931a48741f632155f2859f1e4e1b0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7b2584d06b2d978e9195d74ed632d17304ff49e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84dd3de656d20a0956f33e78bd80d9726fd51a05
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2422ca4210b73182eccac8be575161f62a2903ca
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:49f882d0e641bc9f72df8abac26bdd766cda50cf
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d86797f1b6242bc51e6974130fabed65a71440e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f02809910a036dc7a7585fcfeb813332a6f260af
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9b7fc16cd120391dff388c2acedbf31544f7e9e6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c67489ab363319064fc8ef96dab900d2b378e5aa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:79bdb549e437419ecb5710252c1ab432fd95402a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:095b130731eee6c213cc72930f7e4bfaf860d6c6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3a476213e8e905492584227360e5ba1a098abc8a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fc10c81a77d35cb43811a779146788bbdf56633f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2400bd7db0ca250b222bca975671c85475cd16c4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:de5486b67096d72be18ce2911c4fa9eed9aecda8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:23bc8e731e4de12ef672ef4d728c76e3753c3458
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04ba2f8e19acbff86b5b61823c818cb5676fa25f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f48adeb817e008f90886499a93d7ea9265bb5343
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cdfdac8f9e4349e08a3c7c406d5f7e5e988384e2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:683241403d9b38ada5dac58fa5e8408eadf5ab78
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7cb4916670b27349780731d7622c1c22d5963560
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d5eee05befd45786d1c9eb5a2fbe2db6bc4a9f3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fb99bb25e16dcfb277084f0a6daa4c0d3c9019c2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e78148ca81fd41a7b39f46d25d12911f0a331938
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a273bc4e7b1a511cc68ea07a0787cfbaa08c3b7e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fb6ce55f24604cf21f962db64cc69b364ebc5d4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53d4b871f85e24bc4cce02debcce63a86e2521ce
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:84d52396a70e60c723bf79f703737cfcd8962b30
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c23201907940957f21bd2ded7e92e02583066f34
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:db53dd212030492675f17185a12c79e8961c8f0a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1e39b60056e30dfc93e7042becbee9a27f57c1b3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dcee2d5d2c80bc30445eae87026486504190368d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:78bb3f94cfb297ce7aecde656ffceb71fe19f375
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2aea43dbad74b62200d0b00f49227721e5b1e6d7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:06833bcaffb65e8d01df2ea279d1b82877d7e8c2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5152daad9225ab73bfea35b5b1721c4cf027ae4e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e34095d1c75e15acdcb4911599e987987ebce9c8
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7dae74c51b6690c25c7e8ddad0850094f75d634a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5fb4c23d39af65333758a3e64b972592c7ec3f37
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6528d4eca1ffe5cce9f25e0b7f522317ee9257e2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7d4a2acd4e5535469dda796d4d100b57e73ec0b7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a90fff158d0a2397ef9d8e559d563a77e2c3704
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:99256a351d591205542ca167e65fcc10e118e95e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a1c0f523195b66d59ed79d9a31b91721088b6ee
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:15846f2c018e581b389fdf2bbe7b4506e167800d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:13e83b0b7daeed1de5a16be224d3b9fbdc323cf3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b84c74a88f1e4527aba8a2600d22e925bd022d6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4cfada0e631a6760541c540ff339412a4ccf8297
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3c0f7307be815e8c8ee1ba195f4375a60e7cef15
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b7946e933994f5b196877a36df9caf702843bfe7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2abf2a389454d8dec22ec51b115bdbadead86142
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1af523e9665edb9099eb95694d21510e542c656e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:94b43d647a9283ce67fe81ca436e094284c12047
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bff86ef338baa34612c49ea6edad81d543fb1ab4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ed199ce55b1436e8df55722a4c3074167afe281c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0164c92733ea4acd6b5eea33d4b5898367d48383
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:04eced2228d03d07e69bf6cdc4d6059113ada27b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:dd505aceb5e690e5e4927cb1d32b28dd3e6e7cbe
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90566eabc493bd329e4b5cf9725ffed0a288c027
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7e0e72b5913d5d4444b1ebf864e4d1fcf8b9e054
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e7427c2d871477d84f6ebe35229de834c7f3063e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4cc284f04fdc64445e78f9b727d7a79126fecfbb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f072279edc340886ca4e0b201faf760b65cbd445
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a005f2d883be5f3872ffff68dce471c3a92f9553
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:581810bede83203f85e1376cc1b12b298d963670
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0cb9d763af83c053e706dcd182d6751b8026c81e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:057823f9e7257642db0bd50d59fe3759727f8f61
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5f4e7bea66a245383d712b10ac1e45e61cae0fde
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d1ebe3dadca38b69f52c52fb1503294bb59021af
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:831c96f7a7995567173b5020451b7f325a89cb0e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c2ac6da7827ddc1caf42707f962eaf329d9c3f4c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9c2af2cc479c303148dc37009366f2a68bb11967
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5736d2cdfa063a674fa1b1d1e475452f806c4a93
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24f253bae12653b2301aeb0fb60660d75387b7e1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c805cfc28e732f882d071465f2cc786eac8b664b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9257d69120354f65e361b4d3c9fd56f32f8d6a64
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:002ce12f05eb06650214af0bff53c69f69b09d3b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bf41d333d4d19299a752cdb96c87688eb9fc0efa
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:30a16111d03026ff6f1b034508a6834ebb8d6679
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e708f0c3e17db16be2d534bffecad9de8ede8a15
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:490a517964cefdc3785dc7388892e831ad7cdfbc
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f8a75eb1241ca03de7a67eb1dd75aabe77f5f50b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf9b9bff8f999177cef6008f6e043d631bcad907
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93271dbfa00121da75f94d8c135205c0e1c6d3f4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:27ba42c39cb840a422d836086e6ec39281a77790
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:507ef9fb27aed0f13d3d5be781af969bd804fd5e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:706760d4d629af8dd4673515b2fceb3d24888664
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5cc262c20f37c0d7489f79511c4245153c445748
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a29f51d681e7b5538c445440d3ab150f4266d573
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5e9d6b36de1403f71ee9096a8d507a6663792c90
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:24e729705e5a2a2c92b43af76b5defdd18f8f914
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:19227b41bfef752ed9cbe875e8db2a36ee3c46b7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d991f5d0963f638d12b8e56366a046e18ce29481
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:34ed3b4eb90a94006ddca2df8a4de5613224df80
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1b4f77a13e483a8c3f5ce0bf267a431fac8eac1b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a0d08cc4daf8562488dc66f807b16586aa6ab7a4
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e61f9eaa1eeeb64945d95bb6171bea8ffda74811
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2a7c5dab46aa6e249d7cd3c146e013050adf9db3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:35141b690622485206cf9838e092d20709fdbe9c
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:86032ef226a7f5b922df904cebbd537c6c1cd4a3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ab506f02be882b694f8640c737842ef12ec8b125
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3f9c5dc598c64daba39ab22321e2163f17a4a64a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a7e0d5bee713a0bec9a1ab828641ce7f981a6f28
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b5b405a917cf179b78f09e6191eebdcf790b0845
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ba2701b66722da3e09a4a50f951066e66335b79
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:563a9ce64b1665bd183b1c61b9c0e6ccc8d1ae16
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:448ce8bcdb20480e23951740b6d5888228ac5ece
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d9ceb8020295410e28f4fba84dd9f9da0c9f76b0
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:140610db888c0e17cd8fddf87d6a337534051ea1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5a9e5925bc2135be57faf3eb09e7ce5f5985219
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:96725cfd93dab90aa87279dd89955720bfab3e5f
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ae1cbab0071b8f68246d1234a31789466abe7cac
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:282738a0978ad718919f11d141f7ed28cf8bf00b
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:64997bbaccf8f0c6b3c11b2ac102a544749c3b3e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1dc4a198bef5ae8e87e2a9c7917f5a18a8e87524
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6b139d8923ca57a89476e69c7e69623f3d027c17
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3729a07682d75b6b6b5468717ba78ab76a40cd5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5a30d699817028d587703e9c4a0848d5988030a5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:12e9dc010efac0e440dee70fece9366c10dab38a
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5bcb684c65b1faf156c940b3bf085c23950965eb
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ce5a6900fa5bb8a27717098dcc277e4411f114b6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4a2c50d8f8377e048ddd1c8d68877d07d836e8d2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41bf1c6cea7fb8915058a1bf6b1bb45c3a9dc378
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d5f56265f022d57ecfcffc11e89527c84464f4a9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:512e622846a5faa808b5716dde22f77753798a37
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:46dc1bc9ee1809b763b6994ba2c67ca74163bb0e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b49085f6ef2c7596f414e6d3711c3cf1db59e72e
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3edd5162266daec99a82fd5a37e63a7218797cb1
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:176a3a0d95781d440312c85f4e12bc11f9871bf6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b30571a9fab3bdb198682275806b88527e1f8904
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b050e2833d4a1c0500e8c39f03f80e8126fe396d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:be4fed4d0e1f2347f43360e56dcea08546243748
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ef1fb4e7f4a6cbed12582978a5af78c886c1ba5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:93ca41f376ed191171f05b30f80395a6c31fcad7
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bc0695cfc279d86076c1cfe01bf96d1e4b30dbc9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:acfeacad7477e0d4415d62406a0de43fc9ccd8a6
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:154c841685ca9da73d846afb395e2fa303086062
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4cbe7f12760f32031317535631679234da08848
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ddfb5c7202572dfe13950503c1a92575a15345a9
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1a279a00aa1c1e56dcd80734d0e5a5e16a4531f5
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ebfaffccd78ccf303849963fffaccf051b739481
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:8df70fa20786aadec9802042dfe6faaff13f8531
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54163b0159ffae7505f6ad129a17a3bb93f330ee
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a4e64c0931d241e532e4fd19b0a042338224b7e2
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7d2bd352292f23b4045e581d40ec098d53e91ba
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cfa6f05d59d74e3c309f12da1324bf4845fdc7bd
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f6274e06c23a07b4fee8c5839c27e37a7a8f33ce
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c75c347b1bc805a14aac4c1eea55cc61c8b49d4d
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b615c0ead4253e6f7a41fa1549894a51546c8dd3
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:163856c26ca18f99b7e3871c036421ee80796474
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9039e70513ba52765118b3533a73e931889cdcba
11/22/2024 01:44:38 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c4f1be6c93c4ade6d70231b7904224f7e96e3086
11/22/2024 01:44:39 PM UTC [INFO] Received an event for node: 67406df011fb139cb87dff08
11/22/2024 01:44:41 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.365710] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.373630] Modules linked in:\n[    4.376690] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.387989] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.397376] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.401823] Code: 48 8b 15 c4 43 10 49 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.420569] RSP: 0018:ffffa83c00037b60 EFLAGS: 00010246\n[    4.425796] RAX: 0000000000000000 RBX: ffff906f465bbd08 RCX: 0000000000000000\n[    4.432929] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa83c00037bc0\n[    4.440061] RBP: ffff906f465bbd08 R08: ffff906f465b1fa0 R09: ffff906f4233c000\n[    4.447197] R10: 0000000000000040 R11: ffffffffba52fd88 R12: ffff906f46580000\n[    4.454330] R13: ffff906f465b4fe0 R14: ffffa83c00037b68 R15: 0000000000000001\n[    4.461461] FS:  0000000000000000(0000) GS:ffff907067080000(0000) knlGS:0000000000000000\n[    4.469548] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.475293] CR2: 0000000000000000 CR3: 00000001b0c28000 CR4: 00000000003506f0\n[    4.482423] Call Trace:\n[    4.484876]  <TASK>\n[    4.486982]  ? __warn+0x85/0x130\n[    4.490218]  ? __flush_work+0x29f/0x2c0\n[    4.494058]  ? report_bug+0x160/0x190\n[    4.497726]  ? handle_bug+0x53/0x90\n[    4.501219]  ? exc_invalid_op+0x13/0x60\n[    4.505060]  ? asm_exc_invalid_op+0x16/0x20\n[    4.509250]  ? __flush_work+0x29f/0x2c0\n[    4.513093]  cancel_delayed_work_sync+0x6e/0x90\n[    4.517628]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.522163]  amdgpu_ring_alloc+0x3f/0x60\n[    4.526092]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.531233]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.535681]  amdgpu_device_init+0x205f/0x26f0\n[    4.540043]  amdgpu_driver_load_kms+0x15/0x80\n[    4.544404]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.548417]  pci_device_probe+0x98/0x120\n[    4.552344]  really_probe+0xd1/0x2b0\n[    4.555928]  ? __device_attach_driver+0xc0/0xc0\n[    4.560463]  __driver_probe_device+0x73/0x120\n[    4.564825]  driver_probe_device+0x1f/0x90\n[    4.568925]  __driver_attach+0x84/0x130\n[    4.572767]  bus_for_each_dev+0x84/0xd0\n[    4.576609]  bus_add_driver+0xe4/0x210\n[    4.580361]  driver_register+0x55/0x100\n[    4.584201]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.588996]  do_one_initcall+0x57/0x300\n[    4.592839]  kernel_init_freeable+0x1be/0x300\n[    4.597199]  ? rest_init+0xc0/0xc0\n[    4.600605]  kernel_init+0x16/0x1b0\n[    4.604098]  ret_from_fork+0x30/0x50\n[    4.607680]  ? rest_init+0xc0/0xc0\n[    4.611085]  ret_from_fork_asm+0x11/0x20\n[    4.615012]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? _raw_spin_unlock_irqrestore+0xe/0x30', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.816295] WARNING: CPU: 0 PID: 9 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.824213] Modules linked in:\n[    4.827273] CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.840219] Tainted: [W]=WARN\n[    4.843195] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.852582] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.859026] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.863474] Code: 48 8b 15 c4 43 10 49 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.882222] RSP: 0018:ffffa83c00077c58 EFLAGS: 00010246\n[    4.887449] RAX: 0000000000000000 RBX: ffff906f465bbd08 RCX: 0000000000000000\n[    4.894591] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffa83c00077cb8\n[    4.901730] RBP: ffff906f465bbd08 R08: ffffa83c00077de8 R09: 0000000000000000\n[    4.908867] R10: ffffa83c00077b30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.916002] R13: ffff906f465b4fe0 R14: ffffa83c00077c60 R15: 0000000000000001\n[    4.923138] FS:  0000000000000000(0000) GS:ffff907067000000(0000) knlGS:0000000000000000\n[    4.931224] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.936973] CR2: ffff906ff1a01000 CR3: 00000001b0c28000 CR4: 00000000003506f0\n[    4.944109] Call Trace:\n[    4.946566]  <TASK>\n[    4.948676]  ? __warn+0x85/0x130\n[    4.951911]  ? __flush_work+0x29f/0x2c0\n[    4.955752]  ? report_bug+0x160/0x190\n[    4.959427]  ? handle_bug+0x53/0x90\n[    4.962924]  ? exc_invalid_op+0x13/0x60\n[    4.966768]  ? asm_exc_invalid_op+0x16/0x20\n[    4.970960]  ? __flush_work+0x29f/0x2c0\n[    4.974808]  cancel_delayed_work_sync+0x6e/0x90\n[    4.979347]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.983887]  amdgpu_ring_alloc+0x3f/0x60\n[    4.987818]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.991925]  amdgpu_job_submit_direct+0x30/0x50\n[    4.996464]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.001438]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.005808]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.011648]  process_one_work+0x18b/0x3d0\n[    5.015667]  worker_thread+0x2e4/0x420\n[    5.019425]  ? _raw_spin_unlock_irqrestore+0xe/0x30\n[    5.024309]  ? rescuer_thread+0x5d0/0x5d0\n[    5.028324]  kthread+0xdf/0x110\n[    5.031472]  ? kthread_park+0x90/0x90\n[    5.035144]  ret_from_fork+0x30/0x50\n[    5.038727]  ? kthread_park+0x90/0x90\n[    5.042396]  ret_from_fork_asm+0x11/0x20\n[    5.046328]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.355046] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.362967] Modules linked in:\n[    4.366029] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.377322] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.386708] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.391156] Code: 48 8b 15 c4 43 10 6a 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.409904] RSP: 0018:ffffaa7200037b60 EFLAGS: 00010246\n[    4.415130] RAX: 0000000000000000 RBX: ffff8ef086e3bd08 RCX: 0000000000000000\n[    4.422263] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffaa7200037bc0\n[    4.429395] RBP: ffff8ef086e3bd08 R08: ffff8ef086e31fa0 R09: ffff8ef080f7c000\n[    4.436526] R10: 0000000000000040 R11: ffffffff9952fd88 R12: ffff8ef086e00000\n[    4.443657] R13: ffff8ef086e34fe0 R14: ffffaa7200037b68 R15: 0000000000000001\n[    4.450788] FS:  0000000000000000(0000) GS:ffff8ef1a6e00000(0000) knlGS:0000000000000000\n[    4.458874] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.464618] CR2: ffff8ef1af1ff000 CR3: 00000000c4c28000 CR4: 00000000003506f0\n[    4.471747] Call Trace:\n[    4.474200]  <TASK>\n[    4.476307]  ? __warn+0x85/0x130\n[    4.479541]  ? __flush_work+0x29f/0x2c0\n[    4.483382]  ? report_bug+0x160/0x190\n[    4.487053]  ? handle_bug+0x53/0x90\n[    4.490549]  ? exc_invalid_op+0x13/0x60\n[    4.494391]  ? asm_exc_invalid_op+0x16/0x20\n[    4.498579]  ? __flush_work+0x29f/0x2c0\n[    4.502421]  cancel_delayed_work_sync+0x6e/0x90\n[    4.506959]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.511496]  amdgpu_ring_alloc+0x3f/0x60\n[    4.515426]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.520568]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.525015]  amdgpu_device_init+0x205f/0x26f0\n[    4.529378]  amdgpu_driver_load_kms+0x15/0x80\n[    4.533737]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.537753]  pci_device_probe+0x98/0x120\n[    4.541684]  really_probe+0xd1/0x2b0\n[    4.545270]  ? __device_attach_driver+0xc0/0xc0\n[    4.549804]  __driver_probe_device+0x73/0x120\n[    4.554166]  driver_probe_device+0x1f/0x90\n[    4.558267]  __driver_attach+0x84/0x130\n[    4.562107]  bus_for_each_dev+0x84/0xd0\n[    4.565946]  bus_add_driver+0xe4/0x210\n[    4.569701]  driver_register+0x55/0x100\n[    4.573538]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.578332]  do_one_initcall+0x57/0x300\n[    4.582174]  kernel_init_freeable+0x1be/0x300\n[    4.586536]  ? rest_init+0xc0/0xc0\n[    4.589943]  kernel_init+0x16/0x1b0\n[    4.593437]  ret_from_fork+0x30/0x50\n[    4.597018]  ? rest_init+0xc0/0xc0\n[    4.600424]  ret_from_fork_asm+0x11/0x20\n[    4.604353]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.807755] WARNING: CPU: 0 PID: 8 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.815677] Modules linked in:\n[    4.818737] CPU: 0 UID: 0 PID: 8 Comm: kworker/0:0 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.831682] Tainted: [W]=WARN\n[    4.834656] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.844046] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.850493] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.854942] Code: 48 8b 15 c4 43 10 6a 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.873691] RSP: 0018:ffffaa720006fc58 EFLAGS: 00010246\n[    4.878923] RAX: 0000000000000000 RBX: ffff8ef086e3bd08 RCX: 0000000000000000\n[    4.886059] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffaa720006fcb8\n[    4.893198] RBP: ffff8ef086e3bd08 R08: ffffaa720006fde8 R09: 0000000000000000\n[    4.900333] R10: ffffaa720006fb30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.907466] R13: ffff8ef086e34fe0 R14: ffffaa720006fc60 R15: 0000000000000001\n[    4.914601] FS:  0000000000000000(0000) GS:ffff8ef1a6e00000(0000) knlGS:0000000000000000\n[    4.922689] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.928437] CR2: ffff8ef1af1ff000 CR3: 00000000c4c28000 CR4: 00000000003506f0\n[    4.935571] Call Trace:\n[    4.938025]  <TASK>\n[    4.940133]  ? __warn+0x85/0x130\n[    4.943369]  ? __flush_work+0x29f/0x2c0\n[    4.947212]  ? report_bug+0x160/0x190\n[    4.950885]  ? handle_bug+0x53/0x90\n[    4.954386]  ? exc_invalid_op+0x13/0x60\n[    4.958227]  ? asm_exc_invalid_op+0x16/0x20\n[    4.962421]  ? __flush_work+0x29f/0x2c0\n[    4.966266]  cancel_delayed_work_sync+0x6e/0x90\n[    4.970802]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.975342]  amdgpu_ring_alloc+0x3f/0x60\n[    4.979275]  amdgpu_ib_schedule+0xf0/0x7f0\n[    4.983381]  amdgpu_job_submit_direct+0x30/0x50\n[    4.987922]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    4.992892]  amdgpu_ib_ring_tests+0x106/0x170\n[    4.997255]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.003092]  process_one_work+0x18b/0x3d0\n[    5.007112]  worker_thread+0x2e4/0x420\n[    5.010871]  ? rescuer_thread+0x5d0/0x5d0\n[    5.014884]  kthread+0xdf/0x110\n[    5.018033]  ? kthread_park+0x90/0x90\n[    5.021701]  ret_from_fork+0x30/0x50\n[    5.025286]  ? kthread_park+0x90/0x90\n[    5.028957]  ret_from_fork_asm+0x11/0x20\n[    5.032888]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x31/0x180', 'amdgpu_ring_test_helper+0x1c/0x90', 'amdgpu_device_init+0x205f/0x26f0', 'amdgpu_driver_load_kms+0x15/0x80', 'amdgpu_pci_probe+0x17e/0x4f0', 'pci_device_probe+0x98/0x120', 'really_probe+0xd1/0x2b0', '? __device_attach_driver+0xc0/0xc0', '__driver_probe_device+0x73/0x120', 'driver_probe_device+0x1f/0x90', '__driver_attach+0x84/0x130', 'bus_for_each_dev+0x84/0xd0', 'bus_add_driver+0xe4/0x210', 'driver_register+0x55/0x100', '? drm_sched_fence_slab_init+0x90/0x90', 'do_one_initcall+0x57/0x300', 'kernel_init_freeable+0x1be/0x300', '? rest_init+0xc0/0xc0', 'kernel_init+0x16/0x1b0', 'ret_from_fork+0x30/0x50', '? rest_init+0xc0/0xc0', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.396624] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.404543] Modules linked in:\n[    4.407604] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.418896] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.428282] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.432729] Code: 48 8b 15 c4 43 f0 7d 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.451477] RSP: 0018:ffffb12ec0037b60 EFLAGS: 00010246\n[    4.456703] RAX: 0000000000000000 RBX: ffff8a438653bd08 RCX: 0000000000000000\n[    4.463836] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb12ec0037bc0\n[    4.470968] RBP: ffff8a438653bd08 R08: ffff8a4386531fa0 R09: ffff8a43861e5000\n[    4.478090] R10: 0000000000000040 R11: ffffffff8572fd88 R12: ffff8a4386500000\n[    4.485223] R13: ffff8a4386534fe0 R14: ffffb12ec0037b68 R15: 0000000000000001\n[    4.492357] FS:  0000000000000000(0000) GS:ffff8a44a7000000(0000) knlGS:0000000000000000\n[    4.500443] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.506187] CR2: ffff8a441da01000 CR3: 000000019cc28000 CR4: 00000000003506f0\n[    4.513319] Call Trace:\n[    4.515772]  <TASK>\n[    4.517877]  ? __warn+0x85/0x130\n[    4.521112]  ? __flush_work+0x29f/0x2c0\n[    4.524951]  ? report_bug+0x160/0x190\n[    4.528620]  ? handle_bug+0x53/0x90\n[    4.532116]  ? exc_invalid_op+0x13/0x60\n[    4.535957]  ? asm_exc_invalid_op+0x16/0x20\n[    4.540145]  ? __flush_work+0x29f/0x2c0\n[    4.543987]  cancel_delayed_work_sync+0x6e/0x90\n[    4.548522]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    4.553057]  amdgpu_ring_alloc+0x3f/0x60\n[    4.556986]  amdgpu_jpeg_dec_ring_test_ring+0x31/0x180\n[    4.562127]  amdgpu_ring_test_helper+0x1c/0x90\n[    4.566572]  amdgpu_device_init+0x205f/0x26f0\n[    4.570924]  amdgpu_driver_load_kms+0x15/0x80\n[    4.575283]  amdgpu_pci_probe+0x17e/0x4f0\n[    4.579299]  pci_device_probe+0x98/0x120\n[    4.583227]  really_probe+0xd1/0x2b0\n[    4.586808]  ? __device_attach_driver+0xc0/0xc0\n[    4.591343]  __driver_probe_device+0x73/0x120\n[    4.595703]  driver_probe_device+0x1f/0x90\n[    4.599802]  __driver_attach+0x84/0x130\n[    4.603640]  bus_for_each_dev+0x84/0xd0\n[    4.607480]  bus_add_driver+0xe4/0x210\n[    4.611233]  driver_register+0x55/0x100\n[    4.615069]  ? drm_sched_fence_slab_init+0x90/0x90\n[    4.619862]  do_one_initcall+0x57/0x300\n[    4.623701]  kernel_init_freeable+0x1be/0x300\n[    4.628065]  ? rest_init+0xc0/0xc0\n[    4.631472]  kernel_init+0x16/0x1b0\n[    4.634973]  ret_from_fork+0x30/0x50\n[    4.638554]  ? rest_init+0xc0/0xc0\n[    4.641958]  ret_from_fork_asm+0x11/0x20\n[    4.645885]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'call_trace': ['<TASK>', '? __warn+0x85/0x130', '? __flush_work+0x29f/0x2c0', '? report_bug+0x160/0x190', '? handle_bug+0x53/0x90', '? exc_invalid_op+0x13/0x60', '? asm_exc_invalid_op+0x16/0x20', '? __flush_work+0x29f/0x2c0', 'cancel_delayed_work_sync+0x6e/0x90', 'jpeg_v1_0_ring_begin_use+0x1d/0xb0', 'amdgpu_ring_alloc+0x3f/0x60', 'amdgpu_ib_schedule+0xf0/0x7f0', 'amdgpu_job_submit_direct+0x30/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290', 'amdgpu_ib_ring_tests+0x106/0x170', 'amdgpu_device_delayed_init_work_handler+0x11/0x30', 'process_one_work+0x18b/0x3d0', 'worker_thread+0x2e4/0x420', '? rescuer_thread+0x5d0/0x5d0', 'kthread+0xdf/0x110', '? kthread_park+0x90/0x90', 'ret_from_fork+0x30/0x50', '? kthread_park+0x90/0x90', 'ret_from_fork_asm+0x11/0x20', '</TASK>'], 'log_excerpt': '[    4.847913] WARNING: CPU: 0 PID: 8 at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0\n[    4.855832] Modules linked in:\n[    4.858891] CPU: 0 UID: 0 PID: 8 Comm: kworker/0:0 Tainted: G        W          6.12.0-next-20241122 #1 ed6fecfd9da294c8acecd9cd587658150438fa01\n[    4.871835] Tainted: [W]=WARN\n[    4.874806] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.884193] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    4.890642] RIP: 0010:__flush_work+0x29f/0x2c0\n[    4.895090] Code: 48 8b 15 c4 43 f0 7d 48 89 54 24 58 48 8b 73 40 8b 4b 30 e9 b6 fe ff ff 40 30 f6 4c 8b 26 e9 f2 fd ff ff 0f 0b e9 33 ff ff ff <0f> 0b e9 2c ff ff ff 0f 0b e9 d2 fe ff ff e8 ee a6 26 01 66 66 2e\n[    4.913841] RSP: 0018:ffffb12ec006fc58 EFLAGS: 00010246\n[    4.919069] RAX: 0000000000000000 RBX: ffff8a438653bd08 RCX: 0000000000000000\n[    4.926206] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffb12ec006fcb8\n[    4.933341] RBP: ffff8a438653bd08 R08: ffffb12ec006fde8 R09: 0000000000000000\n[    4.940475] R10: ffffb12ec006fb30 R11: 0000000000000000 R12: 00000000000003e8\n[    4.947610] R13: ffff8a4386534fe0 R14: ffffb12ec006fc60 R15: 0000000000000001\n[    4.954743] FS:  0000000000000000(0000) GS:ffff8a44a7000000(0000) knlGS:0000000000000000\n[    4.962831] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.968579] CR2: ffff8a441da01000 CR3: 000000019cc28000 CR4: 00000000003506f0\n[    4.975712] Call Trace:\n[    4.978165]  <TASK>\n[    4.980273]  ? __warn+0x85/0x130\n[    4.983509]  ? __flush_work+0x29f/0x2c0\n[    4.987352]  ? report_bug+0x160/0x190\n[    4.991023]  ? handle_bug+0x53/0x90\n[    4.994519]  ? exc_invalid_op+0x13/0x60\n[    4.998363]  ? asm_exc_invalid_op+0x16/0x20\n[    5.002558]  ? __flush_work+0x29f/0x2c0\n[    5.006403]  cancel_delayed_work_sync+0x6e/0x90\n[    5.010937]  jpeg_v1_0_ring_begin_use+0x1d/0xb0\n[    5.015477]  amdgpu_ring_alloc+0x3f/0x60\n[    5.019410]  amdgpu_ib_schedule+0xf0/0x7f0\n[    5.023515]  amdgpu_job_submit_direct+0x30/0x50\n[    5.028055]  amdgpu_jpeg_dec_ring_test_ib+0xd4/0x290\n[    5.033025]  amdgpu_ib_ring_tests+0x106/0x170\n[    5.037389]  amdgpu_device_delayed_init_work_handler+0x11/0x30\n[    5.043225]  process_one_work+0x18b/0x3d0\n[    5.047242]  worker_thread+0x2e4/0x420\n[    5.050999]  ? rescuer_thread+0x5d0/0x5d0\n[    5.055016]  kthread+0xdf/0x110\n[    5.058163]  ? kthread_park+0x90/0x90\n[    5.061833]  ret_from_fork+0x30/0x50\n[    5.065419]  ? kthread_park+0x90/0x90\n[    5.069088]  ret_from_fork_asm+0x11/0x20\n[    5.073020]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0', 'location': 'kernel/workqueue.c:4192 __flush_work+0x29f/0x2c0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:b8211cc7bb431751c4967b348edc19ec2dfab779', 'issue_id': 'maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084', 'issue_version': 0, 'test_id': 'maestro:67406df011fb139cb87dff08', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dff08
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:def8559b778f3f91eb0bb67f182ee444ca9ed084
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b8211cc7bb431751c4967b348edc19ec2dfab779
11/22/2024 01:44:41 PM UTC [INFO] Received an event for node: 6740745d11fb139cb87e2eb1
11/22/2024 01:44:41 PM UTC [DEBUG] Not sending node to KCIDB: 6740745d11fb139cb87e2eb1
11/22/2024 01:44:41 PM UTC [INFO] Received an event for node: 67406d0511fb139cb87dfa61
11/22/2024 01:44:42 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0511fb139cb87dfa61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0511fb139cb87dfa61', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0511fb139cb87dfa61
11/22/2024 01:44:42 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:42 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0
11/22/2024 01:44:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cf39c90537b343f447a7897dcaf1604fe296e6f0
11/22/2024 01:44:42 PM UTC [INFO] Received an event for node: 6740746311fb139cb87e2eb4
11/22/2024 01:44:42 PM UTC [DEBUG] Not sending node to KCIDB: 6740746311fb139cb87e2eb4
11/22/2024 01:44:42 PM UTC [INFO] Received an event for node: 67406e2911fb139cb87e0362
11/22/2024 01:44:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:f5ba203c97643aeb46044aed4e474983321e8aed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2911fb139cb87e0362', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f5ba203c97643aeb46044aed4e474983321e8aed', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2911fb139cb87e0362', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2911fb139cb87e0362
11/22/2024 01:44:43 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:43 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5ba203c97643aeb46044aed4e474983321e8aed
11/22/2024 01:44:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f5ba203c97643aeb46044aed4e474983321e8aed
11/22/2024 01:44:43 PM UTC [INFO] Received an event for node: 6740726311fb139cb87e286a
11/22/2024 01:44:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726311fb139cb87e286a
11/22/2024 01:44:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740747d11fb139cb87e2eb8
11/22/2024 01:44:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740747d11fb139cb87e2eb9
11/22/2024 01:44:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740747d11fb139cb87e2eba
11/22/2024 01:44:45 PM UTC [INFO] Received an event for node: 6740748211fb139cb87e2ebf
11/22/2024 01:44:45 PM UTC [DEBUG] Not sending node to KCIDB: 6740748211fb139cb87e2ebf
11/22/2024 01:44:45 PM UTC [INFO] Received an event for node: 67406e2a11fb139cb87e03ac
11/22/2024 01:44:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:29cb1974486c8448b1631856ac11a50e571c1f49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:29cb1974486c8448b1631856ac11a50e571c1f49', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ac', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ac
11/22/2024 01:44:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cb1974486c8448b1631856ac11a50e571c1f49
11/22/2024 01:44:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:29cb1974486c8448b1631856ac11a50e571c1f49
11/22/2024 01:44:46 PM UTC [INFO] Received an event for node: 6740748411fb139cb87e2ec2
11/22/2024 01:44:46 PM UTC [DEBUG] Not sending node to KCIDB: 6740748411fb139cb87e2ec2
11/22/2024 01:44:47 PM UTC [INFO] Received an event for node: 67406e2a11fb139cb87e03ae
11/22/2024 01:44:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03ae', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03ae
11/22/2024 01:44:47 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:47 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:47 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72
11/22/2024 01:44:47 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:90329052bab09b2c6190ddb64078ee9f0b8f9c72
11/22/2024 01:44:47 PM UTC [INFO] Received an event for node: 6740748411fb139cb87e2ec5
11/22/2024 01:44:47 PM UTC [DEBUG] Not sending node to KCIDB: 6740748411fb139cb87e2ec5
11/22/2024 01:44:47 PM UTC [INFO] Received an event for node: 67406e2a11fb139cb87e03af
11/22/2024 01:44:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.453587] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.461507] Modules linked in:\n[    4.464568] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.472306] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    4.481779] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.486227] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.504971] RSP: 0018:ffffb4e980033b30 EFLAGS: 00010246\n[    4.510198] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    4.517330] RDX: ffffb4e980033b38 RSI: 0000000000000001 RDI: ffffb4e980033b80\n[    4.524462] RBP: ffff9ca543a388e8 R08: ffff9ca543a2f6f0 R09: ffff9ca5437c8000\n[    4.531592] R10: 0000000000000040 R11: ffffffff92458840 R12: ffff9ca543a00000\n[    4.538721] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.545852] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    4.553935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.559677] CR2: 0000000000000000 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    4.566807] Call Trace:\n[    4.569259]  <TASK>\n[    4.571363]  ? __warn+0x84/0x130\n[    4.574596]  ? __flush_work+0x2d6/0x300\n[    4.578438]  ? report_bug+0x164/0x190\n[    4.582108]  ? handle_bug+0x54/0x90\n[    4.585602]  ? exc_invalid_op+0x17/0x70\n[    4.589441]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.593633]  ? __flush_work+0x2d6/0x300\n[    4.597475]  cancel_delayed_work_sync+0x5c/0x80\n[    4.602010]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.606546]  amdgpu_ring_alloc+0x3e/0x60\n[    4.610475]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.615614]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.620060]  amdgpu_device_init+0x1e4f/0x2530\n[    4.624423]  amdgpu_driver_load_kms+0x14/0x80\n[    4.628784]  amdgpu_pci_probe+0x150/0x490\n[    4.632799]  local_pci_probe+0x3d/0x90\n[    4.636556]  pci_device_probe+0xb5/0x180\n[    4.640482]  really_probe+0xcc/0x2b0\n[    4.644061]  ? __pfx___driver_attach+0x10/0x10\n[    4.648504]  __driver_probe_device+0x6e/0x110\n[    4.652861]  driver_probe_device+0x1a/0xe0\n[    4.656963]  __driver_attach+0x83/0x180\n[    4.660802]  bus_for_each_dev+0x83/0xd0\n[    4.664641]  bus_add_driver+0xe3/0x210\n[    4.668390]  driver_register+0x54/0x100\n[    4.672228]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.676329]  do_one_initcall+0x56/0x220\n[    4.680171]  kernel_init_freeable+0x19e/0x2d0\n[    4.684534]  ? __pfx_kernel_init+0x10/0x10\n[    4.688633]  kernel_init+0x15/0x1c0\n[    4.692124]  ret_from_fork+0x2f/0x50\n[    4.695707]  ? __pfx_kernel_init+0x10/0x10\n[    4.699806]  ret_from_fork_asm+0x1a/0x30\n[    4.703736]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.917209] WARNING: CPU: 1 PID: 45 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.925217] Modules linked in: btusb snd_acp3x_i2s btrtl snd_acp3x_pcm_dma btintel snd_sof_amd_rembrandt snd_sof_amd_renoir btbcm snd_sof_amd_acp uvcvideo snd_acp_config btmtk bluetooth cros_ec_hwmon cros_charge_control cros_usbpd_charger cros_usbpd_logger cros_ec_debugfs snd_soc_acp_rt5682_mach videobuf2_vmalloc snd_sof_pci cros_ec_chardev snd_soc_rt5682_i2c snd_sof_xtensa_dsp cros_ec_sysfs rtw88_8822ce snd_soc_rt5682 snd_sof snd_soc_rl6231 snd_sof_utils rtw88_8822c videobuf2_memops regmap_i2c snd_soc_acp_da7219mx98357_mach acpi_als snd_soc_acpi uvc cros_ec_typec industrialio_triggered_buffer rtw88_pci memconsole_coreboot sp5100_tco kfifo_buf videobuf2_v4l2 watchdog acp_audio_dma snd_soc_cros_ec_codec vpd_sysfs memconsole gsmi videobuf2_common snd_soc_max98357a cros_ec_dev roles snd_soc_core snd_pci_acp3x i2c_piix4 cros_usbpd_notify rtw88_core snd_compress i2c_cros_ec_tunnel typec industrialio snd_pcm_dmaengine elan_i2c coreboot_table chromeos_pstore\n[    7.009435] CPU: 1 UID: 0 PID: 45 Comm: kworker/1:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    7.018912] Tainted: [W]=WARN\n[    7.021882] Hardware name: Google Shuboz/Shuboz, BIOS Google_Shuboz.13434.780.2022_10_13_1418 09/12/2022\n[    7.031355] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    7.037800] RIP: 0010:__flush_work+0x2d6/0x300\n[    7.042248] Code: 70 9e 17 71 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    7.060996] RSP: 0018:ffffb4e9801b7c70 EFLAGS: 00010246\n[    7.066221] RAX: 0000000000000000 RBX: ffff9ca543a388e8 RCX: 0000000000000000\n[    7.073357] RDX: ffffb4e9801b7c78 RSI: 0000000000000001 RDI: ffffb4e9801b7cc0\n[    7.080491] RBP: ffff9ca543a388e8 R08: ffffb4e9801b7df0 R09: 0000000000000000\n[    7.087624] R10: ffffb4e9801b7b38 R11: 0000000000054f42 R12: 00000000000003e8\n[    7.094753] R13: 0000000000000001 R14: ffff9ca543a00000 R15: ffff9ca543a323c0\n[    7.101886] FS:  0000000000000000(0000) GS:ffff9ca667080000(0000) knlGS:0000000000000000\n[    7.109973] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    7.115716] CR2: 00007f2952d9a028 CR3: 00000001fba2e000 CR4: 00000000003506f0\n[    7.122849] Call Trace:\n[    7.125300]  <TASK>\n[    7.127405]  ? __warn+0x84/0x130\n[    7.130642]  ? __flush_work+0x2d6/0x300\n[    7.134481]  ? report_bug+0x164/0x190\n[    7.138154]  ? handle_bug+0x54/0x90\n[    7.141648]  ? exc_invalid_op+0x17/0x70\n[    7.145486]  ? asm_exc_invalid_op+0x1a/0x20\n[    7.149685]  ? __flush_work+0x2d6/0x300\n[    7.153526]  cancel_delayed_work_sync+0x5c/0x80\n[    7.158061]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    7.162598]  amdgpu_ring_alloc+0x3e/0x60\n[    7.166526]  amdgpu_ib_schedule+0xef/0x7f0\n[    7.170631]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.175166]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.180134]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.184494]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.190326]  process_one_work+0x163/0x390\n[    7.194340]  worker_thread+0x2a0/0x3b0\n[    7.198096]  ? __pfx_worker_thread+0x10/0x10\n[    7.202369]  ? __pfx_worker_thread+0x10/0x10\n[    7.206640]  kthread+0xcb/0xf0\n[    7.209701]  ? __pfx_kthread+0x10/0x10\n[    7.213455]  ret_from_fork+0x2f/0x50\n[    7.217037]  ? __pfx_kthread+0x10/0x10\n[    7.220791]  ret_from_fork_asm+0x1a/0x30\n[    7.224720]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e2a11fb139cb87e03af', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:44:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e2a11fb139cb87e03af
11/22/2024 01:44:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:44:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3
11/22/2024 01:44:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d112348af97825260229dcc0cf2a64e8cd8f8b3
11/22/2024 01:44:48 PM UTC [INFO] Received an event for node: 67406e7f11fb139cb87e0e8f
11/22/2024 01:44:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7f11fb139cb87e0e8f
11/22/2024 01:44:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e8f
11/22/2024 01:44:51 PM UTC [INFO] Received an event for node: 674074a211fb139cb87e2ecc
11/22/2024 01:44:51 PM UTC [DEBUG] Not sending node to KCIDB: 674074a211fb139cb87e2ecc
11/22/2024 01:44:51 PM UTC [INFO] Received an event for node: 67406d0611fb139cb87dfa67
11/22/2024 01:44:51 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0611fb139cb87dfa67
11/22/2024 01:44:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0611fb139cb87dfa67
11/22/2024 01:44:52 PM UTC [INFO] Received an event for node: 674074a811fb139cb87e2ecf
11/22/2024 01:44:52 PM UTC [DEBUG] Not sending node to KCIDB: 674074a811fb139cb87e2ecf
11/22/2024 01:44:52 PM UTC [INFO] Received an event for node: 67406e3411fb139cb87e03ff
11/22/2024 01:44:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3411fb139cb87e03ff
11/22/2024 01:44:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3411fb139cb87e03ff
11/22/2024 01:44:52 PM UTC [INFO] Received an event for node: 674070d011fb139cb87e21e9
11/22/2024 01:44:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d011fb139cb87e21e9
11/22/2024 01:44:54 PM UTC [INFO] Received an event for node: 674074c211fb139cb87e2ed6
11/22/2024 01:44:54 PM UTC [DEBUG] Not sending node to KCIDB: 674074c211fb139cb87e2ed6
11/22/2024 01:44:54 PM UTC [INFO] Received an event for node: 67406e3511fb139cb87e0449
11/22/2024 01:44:54 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e0449
11/22/2024 01:44:54 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e0449
11/22/2024 01:44:55 PM UTC [INFO] Received an event for node: 674074c311fb139cb87e2ed9
11/22/2024 01:44:55 PM UTC [DEBUG] Not sending node to KCIDB: 674074c311fb139cb87e2ed9
11/22/2024 01:44:55 PM UTC [INFO] Received an event for node: 67406e3511fb139cb87e044b
11/22/2024 01:44:55 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e044b
11/22/2024 01:44:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044b
11/22/2024 01:44:56 PM UTC [INFO] Received an event for node: 674074c311fb139cb87e2edc
11/22/2024 01:44:56 PM UTC [DEBUG] Not sending node to KCIDB: 674074c311fb139cb87e2edc
11/22/2024 01:44:56 PM UTC [INFO] Received an event for node: 67406e3511fb139cb87e044c
11/22/2024 01:44:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e3511fb139cb87e044c
11/22/2024 01:44:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e3511fb139cb87e044c
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 6732dc3eecee483df9c5455e
11/22/2024 01:44:57 PM UTC [DEBUG] Not sending node to KCIDB: 6732dc3eecee483df9c5455e
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 6732dc53ecee483df9c54561
11/22/2024 01:44:57 PM UTC [DEBUG] Not sending node to KCIDB: 6732dc53ecee483df9c54561
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 6732dc6eecee483df9c54564
11/22/2024 01:44:57 PM UTC [DEBUG] Not sending node to KCIDB: 6732dc6eecee483df9c54564
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 6732dc88ecee483df9c54567
11/22/2024 01:44:57 PM UTC [DEBUG] Not sending node to KCIDB: 6732dc88ecee483df9c54567
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 674074e711fb139cb87e2ee3
11/22/2024 01:44:57 PM UTC [DEBUG] Not sending node to KCIDB: 674074e711fb139cb87e2ee3
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 67406cff11fb139cb87dfa37
11/22/2024 01:44:57 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406cff11fb139cb87dfa37
11/22/2024 01:44:57 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406cff11fb139cb87dfa37
11/22/2024 01:44:57 PM UTC [INFO] Received an event for node: 67406df011fb139cb87dff05
11/22/2024 01:45:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406df011fb139cb87dff05
11/22/2024 01:45:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406df011fb139cb87dff05
11/22/2024 01:45:00 PM UTC [INFO] Received an event for node: 674074ee11fb139cb87e2eea
11/22/2024 01:45:00 PM UTC [DEBUG] Not sending node to KCIDB: 674074ee11fb139cb87e2eea
11/22/2024 01:45:00 PM UTC [INFO] Received an event for node: 67406e4e11fb139cb87e04b5
11/22/2024 01:45:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4e11fb139cb87e04b5
11/22/2024 01:45:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4e11fb139cb87e04b5
11/22/2024 01:45:01 PM UTC [INFO] Received an event for node: 6740750a11fb139cb87e2eed
11/22/2024 01:45:01 PM UTC [DEBUG] Not sending node to KCIDB: 6740750a11fb139cb87e2eed
11/22/2024 01:45:01 PM UTC [INFO] Received an event for node: 67406e4f11fb139cb87e050b
11/22/2024 01:45:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050b
11/22/2024 01:45:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050b
11/22/2024 01:45:02 PM UTC [INFO] Received an event for node: 6740750b11fb139cb87e2ef0
11/22/2024 01:45:02 PM UTC [DEBUG] Not sending node to KCIDB: 6740750b11fb139cb87e2ef0
11/22/2024 01:45:02 PM UTC [INFO] Received an event for node: 67406e4f11fb139cb87e050d
11/22/2024 01:45:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050d
11/22/2024 01:45:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050d
11/22/2024 01:45:03 PM UTC [INFO] Received an event for node: 6740750c11fb139cb87e2ef3
11/22/2024 01:45:03 PM UTC [DEBUG] Not sending node to KCIDB: 6740750c11fb139cb87e2ef3
11/22/2024 01:45:03 PM UTC [INFO] Received an event for node: 67406e4f11fb139cb87e050e
11/22/2024 01:45:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e4f11fb139cb87e050e
11/22/2024 01:45:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e4f11fb139cb87e050e
11/22/2024 01:45:04 PM UTC [INFO] Received an event for node: 6740752511fb139cb87e2ef6
11/22/2024 01:45:04 PM UTC [DEBUG] Not sending node to KCIDB: 6740752511fb139cb87e2ef6
11/22/2024 01:45:04 PM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa70
11/22/2024 01:45:04 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa70', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa70
11/22/2024 01:45:04 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:04 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157
11/22/2024 01:45:04 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5d39a2c35dc1d180fac7e16831c7e9eb6ce47157
11/22/2024 01:45:05 PM UTC [INFO] Received an event for node: 6740752b11fb139cb87e2ef9
11/22/2024 01:45:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740752b11fb139cb87e2ef9
11/22/2024 01:45:05 PM UTC [INFO] Received an event for node: 67406e5011fb139cb87e0549
11/22/2024 01:45:05 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:31ae8dd4585604f93f201b3dbceaed6bc384aa15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5011fb139cb87e0549', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31ae8dd4585604f93f201b3dbceaed6bc384aa15', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5011fb139cb87e0549', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5011fb139cb87e0549
11/22/2024 01:45:05 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:05 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:05 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31ae8dd4585604f93f201b3dbceaed6bc384aa15
11/22/2024 01:45:05 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31ae8dd4585604f93f201b3dbceaed6bc384aa15
11/22/2024 01:45:05 PM UTC [INFO] Received an event for node: 6740701d11fb139cb87e2038
11/22/2024 01:45:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740701d11fb139cb87e2038
11/22/2024 01:45:06 PM UTC [INFO] Received an event for node: 6740754511fb139cb87e2f01
11/22/2024 01:45:06 PM UTC [DEBUG] Not sending node to KCIDB: 6740754511fb139cb87e2f01
11/22/2024 01:45:06 PM UTC [INFO] Received an event for node: 67406e5111fb139cb87e05a0
11/22/2024 01:45:06 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a0', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a0
11/22/2024 01:45:06 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:06 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:06 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e
11/22/2024 01:45:06 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7236e8a2020a9064aa439d2c512eef6198d7b14e
11/22/2024 01:45:07 PM UTC [INFO] Received an event for node: 6740754711fb139cb87e2f04
11/22/2024 01:45:07 PM UTC [DEBUG] Not sending node to KCIDB: 6740754711fb139cb87e2f04
11/22/2024 01:45:07 PM UTC [INFO] Received an event for node: 67406e5111fb139cb87e05a2
11/22/2024 01:45:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a2', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a2
11/22/2024 01:45:07 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:07 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad
11/22/2024 01:45:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ad8d984a00312bbbf3aa43cbbd455a07112232ad
11/22/2024 01:45:08 PM UTC [INFO] Received an event for node: 6740754711fb139cb87e2f07
11/22/2024 01:45:08 PM UTC [DEBUG] Not sending node to KCIDB: 6740754711fb139cb87e2f07
11/22/2024 01:45:08 PM UTC [INFO] Received an event for node: 67406e5111fb139cb87e05a3
11/22/2024 01:45:08 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.237116] WARNING: CPU: 3 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.245039] Modules linked in:\n[    4.248106] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.255844] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    4.264970] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.269419] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.288162] RSP: 0018:ffffa0b080033b30 EFLAGS: 00010246\n[    4.293388] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    4.300523] RDX: ffffa0b080033b38 RSI: 0000000000000001 RDI: ffffa0b080033b80\n[    4.307656] RBP: ffff9ae0837b88e8 R08: ffff9ae0837af6f0 R09: ffff9ae0834a2000\n[    4.314789] R10: 0000000000000040 R11: ffffffff8dc58840 R12: ffff9ae083780000\n[    4.321922] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.329056] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    4.337143] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.342886] CR2: 00007f87f8bc9160 CR3: 000000009ea2e000 CR4: 00000000003506f0\n[    4.350025] Call Trace:\n[    4.352478]  <TASK>\n[    4.354587]  ? __warn+0x84/0x130\n[    4.357821]  ? __flush_work+0x2d6/0x300\n[    4.361663]  ? report_bug+0x164/0x190\n[    4.365336]  ? handle_bug+0x54/0x90\n[    4.368832]  ? exc_invalid_op+0x17/0x70\n[    4.372672]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.376863]  ? __flush_work+0x2d6/0x300\n[    4.380708]  cancel_delayed_work_sync+0x5c/0x80\n[    4.385241]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.389777]  amdgpu_ring_alloc+0x3e/0x60\n[    4.393710]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.398848]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.403297]  amdgpu_device_init+0x1e4f/0x2530\n[    4.407665]  amdgpu_driver_load_kms+0x14/0x80\n[    4.412029]  amdgpu_pci_probe+0x150/0x490\n[    4.416045]  local_pci_probe+0x3d/0x90\n[    4.419804]  pci_device_probe+0xb5/0x180\n[    4.423730]  really_probe+0xcc/0x2b0\n[    4.427311]  ? __pfx___driver_attach+0x10/0x10\n[    4.431758]  __driver_probe_device+0x6e/0x110\n[    4.436119]  driver_probe_device+0x1a/0xe0\n[    4.440220]  __driver_attach+0x83/0x180\n[    4.444059]  bus_for_each_dev+0x83/0xd0\n[    4.447902]  bus_add_driver+0xe3/0x210\n[    4.451655]  driver_register+0x54/0x100\n[    4.455496]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.459602]  do_one_initcall+0x56/0x220\n[    4.463449]  kernel_init_freeable+0x19e/0x2d0\n[    4.467808]  ? __pfx_kernel_init+0x10/0x10\n[    4.471909]  kernel_init+0x15/0x1c0\n[    4.475403]  ret_from_fork+0x2f/0x50\n[    4.478988]  ? __pfx_kernel_init+0x10/0x10\n[    4.483088]  ret_from_fork_asm+0x1a/0x30\n[    4.487019]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'rtw88_8822c', 'rtw88_8822ce', 'rtw88_core', 'rtw88_pci', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.698567] WARNING: CPU: 3 PID: 103 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.706666] Modules linked in: snd_acp3x_i2s snd_acp3x_pcm_dma snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config uvcvideo snd_sof_pci snd_sof_xtensa_dsp videobuf2_vmalloc cros_ec_lid_angle btusb btrtl snd_sof btintel cros_ec_sensors videobuf2_memops snd_sof_utils snd_soc_acpi btbcm uvc cros_ec_sensors_core snd_soc_acp_rt5682_mach rtw88_8822ce videobuf2_v4l2 btmtk bluetooth videobuf2_common snd_pci_acp3x cros_ec_sysfs cros_charge_control cros_ec_hwmon cros_ec_debugfs cros_ec_sensorhub cros_usbpd_logger sp5100_tco cros_ec_chardev snd_soc_rt5682_i2c cros_usbpd_charger rtw88_8822c snd_soc_acp_da7219mx98357_mach snd_soc_rt5682 acp_audio_dma watchdog rtw88_pci snd_soc_cros_ec_codec snd_soc_rl6231 regmap_i2c gsmi snd_soc_max98357a cros_ec_dev cros_ec_typec acpi_als rtw88_core i2c_piix4 snd_soc_core i2c_cros_ec_tunnel roles industrialio_triggered_buffer kfifo_buf snd_compress memconsole_coreboot typec cros_usbpd_notify elan_i2c snd_pcm_dmaengine vpd_sysfs i2c_hid_acpi memconsole industrialio i2c_hid\n[    6.706802]  chromeos_pstore coreboot_table\n[    6.800557] CPU: 3 UID: 0 PID: 103 Comm: kworker/3:3 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.810121] Tainted: [W]=WARN\n[    6.813095] Hardware name: HP Gumboz/Gumboz, BIOS Google_Gumboz.13434.783.2022_11_09_1516 09/12/2022\n[    6.822226] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.828671] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.833121] Code: 70 9e 97 75 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.851868] RSP: 0018:ffffa0b080cdfc70 EFLAGS: 00010246\n[    6.857093] RAX: 0000000000000000 RBX: ffff9ae0837b88e8 RCX: 0000000000000000\n[    6.864229] RDX: ffffa0b080cdfc78 RSI: 0000000000000001 RDI: ffffa0b080cdfcc0\n[    6.871363] RBP: ffff9ae0837b88e8 R08: ffffa0b080cdfdf0 R09: 0000000000000000\n[    6.878507] R10: ffffa0b080cdfb38 R11: 00000000000ee6b2 R12: 00000000000003e8\n[    6.885639] R13: 0000000000000001 R14: ffff9ae083780000 R15: ffff9ae0837b23c0\n[    6.892774] FS:  0000000000000000(0000) GS:ffff9ae0aaf80000(0000) knlGS:0000000000000000\n[    6.900861] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.906609] CR2: 00007fffb6b900e8 CR3: 00000001042e6000 CR4: 00000000003506f0\n[    6.913743] Call Trace:\n[    6.916197]  <TASK>\n[    6.918304]  ? __warn+0x84/0x130\n[    6.921539]  ? __flush_work+0x2d6/0x300\n[    6.925382]  ? report_bug+0x164/0x190\n[    6.929057]  ? handle_bug+0x54/0x90\n[    6.932554]  ? exc_invalid_op+0x17/0x70\n[    6.936399]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.940591]  ? __flush_work+0x2d6/0x300\n[    6.944437]  cancel_delayed_work_sync+0x5c/0x80\n[    6.948971]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.953511]  amdgpu_ring_alloc+0x3e/0x60\n[    6.957442]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.961549]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.966085]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.971052]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.975412]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.981243]  process_one_work+0x163/0x390\n[    6.985259]  worker_thread+0x2a0/0x3b0\n[    6.989015]  ? __pfx_worker_thread+0x10/0x10\n[    6.993292]  ? __pfx_worker_thread+0x10/0x10\n[    6.997567]  kthread+0xcb/0xf0\n[    7.000633]  ? __pfx_kthread+0x10/0x10\n[    7.004388]  ret_from_fork+0x2f/0x50\n[    7.007976]  ? __pfx_kthread+0x10/0x10\n[    7.011729]  ret_from_fork_asm+0x1a/0x30\n[    7.015664]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e5111fb139cb87e05a3', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e5111fb139cb87e05a3
11/22/2024 01:45:08 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:08 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:45:08 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce
11/22/2024 01:45:08 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c3a7ccdfcdfe568a770a1103a55e862cfd1a35ce
11/22/2024 01:45:09 PM UTC [INFO] Received an event for node: 6740726611fb139cb87e2870
11/22/2024 01:45:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726611fb139cb87e2870
11/22/2024 01:45:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740756311fb139cb87e2f0b
11/22/2024 01:45:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740756311fb139cb87e2f0c
11/22/2024 01:45:11 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740756311fb139cb87e2f0d
11/22/2024 01:45:12 PM UTC [INFO] Received an event for node: 6740726a11fb139cb87e2879
11/22/2024 01:45:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740726a11fb139cb87e2879
11/22/2024 01:45:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674075a411fb139cb87e2f13
11/22/2024 01:45:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674075a411fb139cb87e2f14
11/22/2024 01:45:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674075a411fb139cb87e2f15
11/22/2024 01:45:14 PM UTC [INFO] Received an event for node: 674070bb11fb139cb87e218c
11/22/2024 01:45:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070bb11fb139cb87e218c
11/22/2024 01:45:16 PM UTC [INFO] Received an event for node: 674070cf11fb139cb87e21e6
11/22/2024 01:45:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cf11fb139cb87e21e6
11/22/2024 01:45:17 PM UTC [INFO] Received an event for node: 674070e811fb139cb87e2244
11/22/2024 01:45:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:372482f0b7377d1796ff0f40a25a36c1d35b10d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674075de11fb139cb87e2f23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:307c1f5b73f74088e9ea1fa430abc5e02b7fbc6f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674075de11fb139cb87e2f23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:372482f0b7377d1796ff0f40a25a36c1d35b10d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674075de11fb139cb87e2f23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:307c1f5b73f74088e9ea1fa430abc5e02b7fbc6f', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674075de11fb139cb87e2f23', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e811fb139cb87e2244
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674075de11fb139cb87e2f23
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:372482f0b7377d1796ff0f40a25a36c1d35b10d5
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:307c1f5b73f74088e9ea1fa430abc5e02b7fbc6f
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:372482f0b7377d1796ff0f40a25a36c1d35b10d5
11/22/2024 01:45:20 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:307c1f5b73f74088e9ea1fa430abc5e02b7fbc6f
11/22/2024 01:45:20 PM UTC [INFO] Received an event for node: 674070e011fb139cb87e2226
11/22/2024 01:45:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e011fb139cb87e2226
11/22/2024 01:45:22 PM UTC [INFO] Received an event for node: 67406d3111fb139cb87dfb69
11/22/2024 01:45:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d3111fb139cb87dfb69
11/22/2024 01:45:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d3111fb139cb87dfb69
11/22/2024 01:45:23 PM UTC [INFO] Received an event for node: 674070b511fb139cb87e215b
11/22/2024 01:45:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b511fb139cb87e215b
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 01:45:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 01:45:26 PM UTC [INFO] Received an event for node: 674070d911fb139cb87e2204
11/22/2024 01:45:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d911fb139cb87e2204
11/22/2024 01:45:28 PM UTC [INFO] Received an event for node: 674070cd11fb139cb87e21e0
11/22/2024 01:45:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070cd11fb139cb87e21e0
11/22/2024 01:45:31 PM UTC [INFO] Received an event for node: 674070e611fb139cb87e2241
11/22/2024 01:45:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e611fb139cb87e2241
11/22/2024 01:45:33 PM UTC [INFO] Received an event for node: 674070c711fb139cb87e21bb
11/22/2024 01:45:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c711fb139cb87e21bb
11/22/2024 01:45:36 PM UTC [INFO] Received an event for node: 674070c211fb139cb87e21a9
11/22/2024 01:45:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c211fb139cb87e21a9
11/22/2024 01:45:38 PM UTC [INFO] Received an event for node: 674070c611fb139cb87e21b8
11/22/2024 01:45:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c611fb139cb87e21b8
11/22/2024 01:45:40 PM UTC [INFO] Received an event for node: 67406e8611fb139cb87e0fc3
11/22/2024 01:45:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8611fb139cb87e0fc3
11/22/2024 01:45:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740765f11fb139cb87e2f4d
11/22/2024 01:45:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740765f11fb139cb87e2f4e
11/22/2024 01:45:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740765f11fb139cb87e2f4f
11/22/2024 01:45:43 PM UTC [INFO] Received an event for node: 674070d311fb139cb87e21f2
11/22/2024 01:45:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d311fb139cb87e21f2
11/22/2024 01:45:45 PM UTC [INFO] Received an event for node: 674070ba11fb139cb87e2189
11/22/2024 01:45:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070ba11fb139cb87e2189
11/22/2024 01:45:47 PM UTC [INFO] Received an event for node: 674070c011fb139cb87e21a3
11/22/2024 01:45:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070c011fb139cb87e21a3
11/22/2024 01:45:48 PM UTC [INFO] Received an event for node: 67406e7f11fb139cb87e0e24
11/22/2024 01:45:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390', 'issue_id': 'maestro:e1047cb58c81fe8c8ce97f8bcaee760b675085e5', 'issue_version': 0, 'test_id': 'maestro:67406e7f11fb139cb87e0e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390', 'issue_id': 'maestro:e1047cb58c81fe8c8ce97f8bcaee760b675085e5', 'issue_version': 0, 'test_id': 'maestro:67406e7f11fb139cb87e0e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390', 'issue_id': 'maestro:e1047cb58c81fe8c8ce97f8bcaee760b675085e5', 'issue_version': 0, 'test_id': 'maestro:67406e7f11fb139cb87e0e24', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:45:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7f11fb139cb87e0e24
11/22/2024 01:45:51 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390
11/22/2024 01:45:51 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390
11/22/2024 01:45:51 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:571af0a5bc5ff4d3ddb4bd6228e134ddba157390
11/22/2024 01:45:51 PM UTC [INFO] Received an event for node: 6740752e11fb139cb87e2efe
11/22/2024 01:45:51 PM UTC [DEBUG] Not sending node to KCIDB: 6740752e11fb139cb87e2efe
11/22/2024 01:45:51 PM UTC [INFO] Received an event for node: 67406fc711fb139cb87e1f35
11/22/2024 01:45:51 PM UTC [DEBUG] Not sending node to KCIDB: 67406fc711fb139cb87e1f35
11/22/2024 01:45:51 PM UTC [INFO] Received an event for node: 67404ca4aa97ccb012940c5d
11/22/2024 01:45:51 PM UTC [DEBUG] Sending to KCIDB: checkouts: maestro:67404ca4aa97ccb012940c5d
11/22/2024 01:45:51 PM UTC [INFO] Received an event for node: 67406d6111fb139cb87dfc70
11/22/2024 01:45:53 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d6111fb139cb87dfc70
11/22/2024 01:45:53 PM UTC [INFO] Received an event for node: 674070d211fb139cb87e21ef
11/22/2024 01:45:55 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070d211fb139cb87e21ef
11/22/2024 01:45:55 PM UTC [INFO] Received an event for node: 674070df11fb139cb87e2223
11/22/2024 01:45:57 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070df11fb139cb87e2223
11/22/2024 01:45:57 PM UTC [INFO] Received an event for node: 674070e511fb139cb87e223e
11/22/2024 01:45:59 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070e511fb139cb87e223e
11/22/2024 01:45:59 PM UTC [INFO] Received an event for node: 6740792511fb139cb87e2f80
11/22/2024 01:45:59 PM UTC [DEBUG] Not sending node to KCIDB: 6740792511fb139cb87e2f80
11/22/2024 01:45:59 PM UTC [INFO] Received an event for node: 67406d0611fb139cb87dfa64
11/22/2024 01:46:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0611fb139cb87dfa64
11/22/2024 01:46:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0611fb139cb87dfa64
11/22/2024 01:46:00 PM UTC [INFO] Received an event for node: 6740792c11fb139cb87e2f83
11/22/2024 01:46:00 PM UTC [DEBUG] Not sending node to KCIDB: 6740792c11fb139cb87e2f83
11/22/2024 01:46:00 PM UTC [INFO] Received an event for node: 67406e6e11fb139cb87e07d9
11/22/2024 01:46:01 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e07d9
11/22/2024 01:46:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e07d9
11/22/2024 01:46:01 PM UTC [INFO] Received an event for node: 6740794711fb139cb87e2f86
11/22/2024 01:46:01 PM UTC [DEBUG] Not sending node to KCIDB: 6740794711fb139cb87e2f86
11/22/2024 01:46:01 PM UTC [INFO] Received an event for node: 67406e6e11fb139cb87e0823
11/22/2024 01:46:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0823
11/22/2024 01:46:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0823
11/22/2024 01:46:03 PM UTC [INFO] Received an event for node: 6740794811fb139cb87e2f89
11/22/2024 01:46:03 PM UTC [DEBUG] Not sending node to KCIDB: 6740794811fb139cb87e2f89
11/22/2024 01:46:03 PM UTC [INFO] Received an event for node: 67406e6e11fb139cb87e0825
11/22/2024 01:46:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0825
11/22/2024 01:46:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0825
11/22/2024 01:46:04 PM UTC [INFO] Received an event for node: 6740794911fb139cb87e2f8c
11/22/2024 01:46:04 PM UTC [DEBUG] Not sending node to KCIDB: 6740794911fb139cb87e2f8c
11/22/2024 01:46:04 PM UTC [INFO] Received an event for node: 67406e6e11fb139cb87e0826
11/22/2024 01:46:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e6e11fb139cb87e0826
11/22/2024 01:46:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e6e11fb139cb87e0826
11/22/2024 01:46:05 PM UTC [INFO] Received an event for node: 6740796011fb139cb87e2f8f
11/22/2024 01:46:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740796011fb139cb87e2f8f
11/22/2024 01:46:05 PM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa40
11/22/2024 01:46:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa40
11/22/2024 01:46:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa40
11/22/2024 01:46:05 PM UTC [INFO] Received an event for node: 6740796611fb139cb87e2f92
11/22/2024 01:46:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740796611fb139cb87e2f92
11/22/2024 01:46:06 PM UTC [INFO] Received an event for node: 67406e7311fb139cb87e085f
11/22/2024 01:46:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e085f
11/22/2024 01:46:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e085f
11/22/2024 01:46:06 PM UTC [INFO] Received an event for node: 6740797d11fb139cb87e2f95
11/22/2024 01:46:06 PM UTC [DEBUG] Not sending node to KCIDB: 6740797d11fb139cb87e2f95
11/22/2024 01:46:06 PM UTC [INFO] Received an event for node: 67406e7311fb139cb87e08b1
11/22/2024 01:46:07 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b1
11/22/2024 01:46:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b1
11/22/2024 01:46:07 PM UTC [INFO] Received an event for node: 6740797e11fb139cb87e2f98
11/22/2024 01:46:07 PM UTC [DEBUG] Not sending node to KCIDB: 6740797e11fb139cb87e2f98
11/22/2024 01:46:07 PM UTC [INFO] Received an event for node: 67406e7311fb139cb87e08b3
11/22/2024 01:46:08 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b3
11/22/2024 01:46:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b3
11/22/2024 01:46:08 PM UTC [INFO] Received an event for node: 6740797f11fb139cb87e2f9b
11/22/2024 01:46:08 PM UTC [DEBUG] Not sending node to KCIDB: 6740797f11fb139cb87e2f9b
11/22/2024 01:46:08 PM UTC [INFO] Received an event for node: 67406e7311fb139cb87e08b4
11/22/2024 01:46:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7311fb139cb87e08b4
11/22/2024 01:46:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7311fb139cb87e08b4
11/22/2024 01:46:10 PM UTC [INFO] Received an event for node: 671c81b17dd103c228fbad87
11/22/2024 01:46:10 PM UTC [DEBUG] Not sending node to KCIDB: 671c81b17dd103c228fbad87
11/22/2024 01:46:10 PM UTC [INFO] Received an event for node: 674076e111fb139cb87e2f60
11/22/2024 01:46:10 PM UTC [INFO] Received an event for node: 671c81cc7dd103c228fbad88
11/22/2024 01:46:10 PM UTC [DEBUG] Not sending node to KCIDB: 671c81cc7dd103c228fbad88
11/22/2024 01:46:10 PM UTC [INFO] Received an event for node: 674076e111fb139cb87e2f61
11/22/2024 01:46:11 PM UTC [INFO] Received an event for node: 671c81e77dd103c228fbadaf
11/22/2024 01:46:11 PM UTC [DEBUG] Not sending node to KCIDB: 671c81e77dd103c228fbadaf
11/22/2024 01:46:11 PM UTC [INFO] Received an event for node: 674076e111fb139cb87e2f62
11/22/2024 01:46:12 PM UTC [INFO] Received an event for node: 674048127b0bd642f4da2932
11/22/2024 01:46:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674048127b0bd642f4da2932
11/22/2024 01:46:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740830611fb139cb87e2fa5
11/22/2024 01:46:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740830611fb139cb87e2fa6
11/22/2024 01:46:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740830611fb139cb87e2fa7
11/22/2024 01:46:14 PM UTC [INFO] Received an event for node: 674048277b0bd642f4da296b
11/22/2024 01:46:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674048277b0bd642f4da296b
11/22/2024 01:46:16 PM UTC [INFO] Received an event for node: 674048257b0bd642f4da2965
11/22/2024 01:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:674048257b0bd642f4da2965
11/22/2024 01:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:674083cb11fb139cb87e2fb1
11/22/2024 01:46:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:674083cb11fb139cb87e2fe9
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674048257b0bd642f4da2965
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb1
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb2
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb3
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb4
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb5
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb6
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb7
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb8
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fb9
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fba
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fbb
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fbc
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fbd
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fbe
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fbf
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc0
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc1
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc2
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc3
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc4
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc5
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc6
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc7
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc8
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fc9
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fca
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fcb
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fcc
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fcd
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fce
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fcf
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd0
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd1
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd2
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd3
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd4
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd5
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd6
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd7
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd8
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fd9
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fda
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fdb
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fdc
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fdd
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fde
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fdf
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe0
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe1
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe2
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe3
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe4
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe5
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe6
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe7
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe8
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fe9
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fea
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2feb
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fec
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fed
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fee
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2fef
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff0
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff1
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff2
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff3
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff4
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff5
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff6
11/22/2024 01:46:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674083cb11fb139cb87e2ff7
11/22/2024 01:46:39 PM UTC [INFO] Received an event for node: 6740482a7b0bd642f4da2974
11/22/2024 01:46:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740482a7b0bd642f4da2974
11/22/2024 01:46:40 PM UTC [INFO] Received an event for node: 674052e1aa97ccb012941cc9
11/22/2024 01:46:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674052e1aa97ccb012941cc9
11/22/2024 01:46:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846311fb139cb87e3001
11/22/2024 01:46:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846311fb139cb87e3002
11/22/2024 01:46:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846311fb139cb87e3003
11/22/2024 01:46:42 PM UTC [INFO] Received an event for node: 674048297b0bd642f4da2971
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674048297b0bd642f4da2971
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3009
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300a
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300b
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300c
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300d
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300e
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e300f
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3010
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3011
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3012
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3013
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3014
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3015
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3016
11/22/2024 01:46:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740846611fb139cb87e3017
11/22/2024 01:46:49 PM UTC [INFO] Received an event for node: 674052f2aa97ccb012941d2d
11/22/2024 01:46:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674052f2aa97ccb012941d2d
11/22/2024 01:46:50 PM UTC [INFO] Received an event for node: 674052f5aa97ccb012941d36
11/22/2024 01:46:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674052f5aa97ccb012941d36
11/22/2024 01:46:51 PM UTC [INFO] Received an event for node: 674052f4aa97ccb012941d33
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674052f4aa97ccb012941d33
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3025
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3026
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3027
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3028
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3029
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302a
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302b
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302c
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302d
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302e
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e302f
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3030
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3031
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3032
11/22/2024 01:46:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740859111fb139cb87e3033
11/22/2024 01:46:59 PM UTC [INFO] Received an event for node: 6740703611fb139cb87e204f
11/22/2024 01:47:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740703611fb139cb87e204f
11/22/2024 01:47:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740860811fb139cb87e3039
11/22/2024 01:47:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740860811fb139cb87e303a
11/22/2024 01:47:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740860811fb139cb87e303b
11/22/2024 01:47:01 PM UTC [INFO] Received an event for node: 6740861311fb139cb87e3040
11/22/2024 01:47:01 PM UTC [DEBUG] Not sending node to KCIDB: 6740861311fb139cb87e3040
11/22/2024 01:47:01 PM UTC [INFO] Received an event for node: 67406d0011fb139cb87dfa3d
11/22/2024 01:47:02 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0011fb139cb87dfa3d
11/22/2024 01:47:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0011fb139cb87dfa3d
11/22/2024 01:47:02 PM UTC [INFO] Received an event for node: 6740861b11fb139cb87e3043
11/22/2024 01:47:02 PM UTC [DEBUG] Not sending node to KCIDB: 6740861b11fb139cb87e3043
11/22/2024 01:47:02 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0d9a
11/22/2024 01:47:03 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0d9a
11/22/2024 01:47:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0d9a
11/22/2024 01:47:03 PM UTC [INFO] Received an event for node: 6740863311fb139cb87e3046
11/22/2024 01:47:03 PM UTC [DEBUG] Not sending node to KCIDB: 6740863311fb139cb87e3046
11/22/2024 01:47:03 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0de4
11/22/2024 01:47:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de4
11/22/2024 01:47:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de4
11/22/2024 01:47:04 PM UTC [INFO] Received an event for node: 6740863411fb139cb87e3049
11/22/2024 01:47:04 PM UTC [DEBUG] Not sending node to KCIDB: 6740863411fb139cb87e3049
11/22/2024 01:47:04 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0de6
11/22/2024 01:47:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de6
11/22/2024 01:47:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de6
11/22/2024 01:47:05 PM UTC [INFO] Received an event for node: 6740863511fb139cb87e304c
11/22/2024 01:47:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740863511fb139cb87e304c
11/22/2024 01:47:05 PM UTC [INFO] Received an event for node: 67406e7e11fb139cb87e0de7
11/22/2024 01:47:05 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e7e11fb139cb87e0de7
11/22/2024 01:47:05 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e7e11fb139cb87e0de7
11/22/2024 01:47:06 PM UTC [INFO] Received an event for node: 6740704811fb139cb87e2092
11/22/2024 01:47:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740704811fb139cb87e2092
11/22/2024 01:47:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:674086af11fb139cb87e3050
11/22/2024 01:47:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:674086af11fb139cb87e3088
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704811fb139cb87e2092
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3050
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3051
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3052
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3053
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3054
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3055
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3056
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3057
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3058
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3059
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305a
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305b
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305c
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305d
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305e
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e305f
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3060
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3061
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3062
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3063
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3064
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3065
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3066
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3067
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3068
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3069
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306a
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306b
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306c
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306d
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306e
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e306f
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3070
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3071
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3072
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3073
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3074
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3075
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3076
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3077
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3078
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3079
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307a
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307b
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307c
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307d
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307e
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e307f
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3080
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3081
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3082
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3083
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3084
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3085
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3086
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3087
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3088
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3089
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308a
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308b
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308c
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308d
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308e
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e308f
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3090
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3091
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3092
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3093
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3094
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3095
11/22/2024 01:47:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674086af11fb139cb87e3096
11/22/2024 01:47:29 PM UTC [INFO] Received an event for node: 6740704a11fb139cb87e2098
11/22/2024 01:47:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704a11fb139cb87e2098
11/22/2024 01:47:30 PM UTC [INFO] Received an event for node: 6740704e11fb139cb87e20a1
11/22/2024 01:47:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704e11fb139cb87e20a1
11/22/2024 01:47:31 PM UTC [INFO] Received an event for node: 6740704c11fb139cb87e209e
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704c11fb139cb87e209e
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a4
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a5
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a6
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a7
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a8
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30a9
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30aa
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30ab
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30ac
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30ad
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30ae
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30af
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30b0
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30b1
11/22/2024 01:47:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674087a711fb139cb87e30b2
11/22/2024 01:47:39 PM UTC [INFO] Received an event for node: 6740887b11fb139cb87e30b7
11/22/2024 01:47:39 PM UTC [DEBUG] Not sending node to KCIDB: 6740887b11fb139cb87e30b7
11/22/2024 01:47:39 PM UTC [INFO] Received an event for node: 67406d0511fb139cb87dfa5e
11/22/2024 01:47:39 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0511fb139cb87dfa5e
11/22/2024 01:47:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0511fb139cb87dfa5e
11/22/2024 01:47:39 PM UTC [INFO] Received an event for node: 6740888111fb139cb87e30ba
11/22/2024 01:47:39 PM UTC [DEBUG] Not sending node to KCIDB: 6740888111fb139cb87e30ba
11/22/2024 01:47:39 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0f1d
11/22/2024 01:47:40 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f1d
11/22/2024 01:47:40 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f1d
11/22/2024 01:47:40 PM UTC [INFO] Received an event for node: 6740889b11fb139cb87e30bd
11/22/2024 01:47:40 PM UTC [DEBUG] Not sending node to KCIDB: 6740889b11fb139cb87e30bd
11/22/2024 01:47:41 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0f67
11/22/2024 01:47:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f67
11/22/2024 01:47:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f67
11/22/2024 01:47:42 PM UTC [INFO] Received an event for node: 6740889c11fb139cb87e30c0
11/22/2024 01:47:42 PM UTC [DEBUG] Not sending node to KCIDB: 6740889c11fb139cb87e30c0
11/22/2024 01:47:42 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0f69
11/22/2024 01:47:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f69
11/22/2024 01:47:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f69
11/22/2024 01:47:43 PM UTC [INFO] Received an event for node: 6740889d11fb139cb87e30c3
11/22/2024 01:47:43 PM UTC [DEBUG] Not sending node to KCIDB: 6740889d11fb139cb87e30c3
11/22/2024 01:47:43 PM UTC [INFO] Received an event for node: 67406e8111fb139cb87e0f6a
11/22/2024 01:47:44 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e8111fb139cb87e0f6a
11/22/2024 01:47:44 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e8111fb139cb87e0f6a
11/22/2024 01:51:19 PM UTC [INFO] Received an event for node: 67408c5711fb139cb87e30c6
11/22/2024 01:51:19 PM UTC [DEBUG] Not sending node to KCIDB: 67408c5711fb139cb87e30c6
11/22/2024 01:51:19 PM UTC [INFO] Received an event for node: 67406d0211fb139cb87dfa4c
11/22/2024 01:51:20 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:faee94d4a481cb5e71e35f93fb7f16505481a6e4', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406d0211fb139cb87dfa4c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:51:20 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0211fb139cb87dfa4c
11/22/2024 01:51:20 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:faee94d4a481cb5e71e35f93fb7f16505481a6e4
11/22/2024 01:51:25 PM UTC [INFO] Received an event for node: 67408c5d11fb139cb87e30c9
11/22/2024 01:51:25 PM UTC [DEBUG] Not sending node to KCIDB: 67408c5d11fb139cb87e30c9
11/22/2024 01:51:25 PM UTC [INFO] Received an event for node: 67406e9d11fb139cb87e11bb
11/22/2024 01:51:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:268cc8ea9e850d356d2dfe1346f2f29f39610868', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e11bb', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:51:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e11bb
11/22/2024 01:51:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:268cc8ea9e850d356d2dfe1346f2f29f39610868
11/22/2024 01:51:46 PM UTC [INFO] Received an event for node: 67408c7211fb139cb87e30cc
11/22/2024 01:51:46 PM UTC [DEBUG] Not sending node to KCIDB: 67408c7211fb139cb87e30cc
11/22/2024 01:51:46 PM UTC [INFO] Received an event for node: 67406e9d11fb139cb87e1205
11/22/2024 01:51:47 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:88fa715a37a9a4862ffd1e2e10547e6e10d36442', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1205', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:51:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1205
11/22/2024 01:51:47 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:88fa715a37a9a4862ffd1e2e10547e6e10d36442
11/22/2024 01:51:47 PM UTC [INFO] Received an event for node: 67408c7311fb139cb87e30cf
11/22/2024 01:51:47 PM UTC [DEBUG] Not sending node to KCIDB: 67408c7311fb139cb87e30cf
11/22/2024 01:51:47 PM UTC [INFO] Received an event for node: 67406e9d11fb139cb87e1207
11/22/2024 01:51:48 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:54688f4f94db8b113246d44fddafc42ec209c2a9', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:51:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1207
11/22/2024 01:51:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:54688f4f94db8b113246d44fddafc42ec209c2a9
11/22/2024 01:51:48 PM UTC [INFO] Received an event for node: 67408c7411fb139cb87e30d2
11/22/2024 01:51:48 PM UTC [DEBUG] Not sending node to KCIDB: 67408c7411fb139cb87e30d2
11/22/2024 01:51:48 PM UTC [INFO] Received an event for node: 67406e9d11fb139cb87e1208
11/22/2024 01:51:49 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:53c112ccb896a04cf4d438fbea27db03f5230f65', 'issue_id': 'maestro:155a87efb72802cd43547fea54f347964aad0a33', 'issue_version': 0, 'test_id': 'maestro:67406e9d11fb139cb87e1208', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:51:49 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9d11fb139cb87e1208
11/22/2024 01:51:49 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:53c112ccb896a04cf4d438fbea27db03f5230f65
11/22/2024 01:52:09 PM UTC [INFO] Received an event for node: 67408c8911fb139cb87e30d5
11/22/2024 01:52:09 PM UTC [DEBUG] Not sending node to KCIDB: 67408c8911fb139cb87e30d5
11/22/2024 01:52:09 PM UTC [INFO] Received an event for node: 67406d0411fb139cb87dfa58
11/22/2024 01:52:09 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0411fb139cb87dfa58
11/22/2024 01:52:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0411fb139cb87dfa58
11/22/2024 01:52:14 PM UTC [INFO] Received an event for node: 67408c8e11fb139cb87e30d8
11/22/2024 01:52:14 PM UTC [DEBUG] Not sending node to KCIDB: 67408c8e11fb139cb87e30d8
11/22/2024 01:52:15 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e1241
11/22/2024 01:52:15 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e1241
11/22/2024 01:52:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1241
11/22/2024 01:52:40 PM UTC [INFO] Received an event for node: 67408ca811fb139cb87e30db
11/22/2024 01:52:40 PM UTC [DEBUG] Not sending node to KCIDB: 67408ca811fb139cb87e30db
11/22/2024 01:52:40 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12c1
11/22/2024 01:52:41 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c1
11/22/2024 01:52:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c1
11/22/2024 01:52:41 PM UTC [INFO] Received an event for node: 67408ca911fb139cb87e30de
11/22/2024 01:52:41 PM UTC [DEBUG] Not sending node to KCIDB: 67408ca911fb139cb87e30de
11/22/2024 01:52:42 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12c5
11/22/2024 01:52:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c5
11/22/2024 01:52:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c5
11/22/2024 01:52:42 PM UTC [INFO] Received an event for node: 67408caa11fb139cb87e30e1
11/22/2024 01:52:42 PM UTC [DEBUG] Not sending node to KCIDB: 67408caa11fb139cb87e30e1
11/22/2024 01:52:42 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12c6
11/22/2024 01:52:43 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406e9f11fb139cb87e12c6
11/22/2024 01:52:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12c6
11/22/2024 01:53:02 PM UTC [INFO] Received an event for node: 67408cbe11fb139cb87e30e4
11/22/2024 01:53:02 PM UTC [DEBUG] Not sending node to KCIDB: 67408cbe11fb139cb87e30e4
11/22/2024 01:53:02 PM UTC [INFO] Received an event for node: 67406d0811fb139cb87dfa73
11/22/2024 01:53:03 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0811fb139cb87dfa73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0811fb139cb87dfa73', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:53:03 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0811fb139cb87dfa73
11/22/2024 01:53:03 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:03 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:03 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d
11/22/2024 01:53:03 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0c758bc7b7f571e5d231b6baa87d4ef5a6bf0f6d
11/22/2024 01:53:08 PM UTC [INFO] Received an event for node: 67408cc411fb139cb87e30e7
11/22/2024 01:53:08 PM UTC [DEBUG] Not sending node to KCIDB: 67408cc411fb139cb87e30e7
11/22/2024 01:53:08 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e1254
11/22/2024 01:53:09 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cbd6235b19f8f1d7991866558d7717e7cfbb93f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e1254', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cbd6235b19f8f1d7991866558d7717e7cfbb93f0', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e1254', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:53:09 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e1254
11/22/2024 01:53:09 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:09 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:09 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbd6235b19f8f1d7991866558d7717e7cfbb93f0
11/22/2024 01:53:09 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cbd6235b19f8f1d7991866558d7717e7cfbb93f0
11/22/2024 01:53:32 PM UTC [INFO] Received an event for node: 67408cdc11fb139cb87e30ea
11/22/2024 01:53:32 PM UTC [DEBUG] Not sending node to KCIDB: 67408cdc11fb139cb87e30ea
11/22/2024 01:53:32 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12e8
11/22/2024 01:53:33 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12e8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:53:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12e8
11/22/2024 01:53:33 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:33 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d
11/22/2024 01:53:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d7deb0e12f42ad8bbf48f2fe9c063cfdbda90b2d
11/22/2024 01:53:34 PM UTC [INFO] Received an event for node: 67408cde11fb139cb87e30ed
11/22/2024 01:53:34 PM UTC [DEBUG] Not sending node to KCIDB: 67408cde11fb139cb87e30ed
11/22/2024 01:53:34 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12ec
11/22/2024 01:53:35 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:cc914bf5b04a8686435e15660cd76baa89619db8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:cc914bf5b04a8686435e15660cd76baa89619db8', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ec', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:53:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ec
11/22/2024 01:53:35 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:35 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc914bf5b04a8686435e15660cd76baa89619db8
11/22/2024 01:53:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:cc914bf5b04a8686435e15660cd76baa89619db8
11/22/2024 01:53:35 PM UTC [INFO] Received an event for node: 67408cdf11fb139cb87e30f0
11/22/2024 01:53:35 PM UTC [DEBUG] Not sending node to KCIDB: 67408cdf11fb139cb87e30f0
11/22/2024 01:53:35 PM UTC [INFO] Received an event for node: 67406e9f11fb139cb87e12ee
11/22/2024 01:53:37 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.407940] WARNING: CPU: 0 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.415860] Modules linked in:\n[    4.418920] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.426659] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.435350] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.439786] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.458531] RSP: 0018:ffffa64b80033b30 EFLAGS: 00010246\n[    4.463757] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    4.470890] RDX: ffffa64b80033b38 RSI: 0000000000000001 RDI: ffffa64b80033b80\n[    4.478021] RBP: ffff8c75039388e8 R08: ffff8c750392f6f0 R09: ffff8c7503820000\n[    4.485152] R10: 0000000000000040 R11: ffffffff95c58840 R12: ffff8c7503900000\n[    4.492283] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.499414] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    4.507499] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.513241] CR2: 00007f215099e160 CR3: 0000000035a2e000 CR4: 00000000003506f0\n[    4.520370] Call Trace:\n[    4.522822]  <TASK>\n[    4.524927]  ? __warn+0x84/0x130\n[    4.528160]  ? __flush_work+0x2d6/0x300\n[    4.531999]  ? report_bug+0x164/0x190\n[    4.535666]  ? handle_bug+0x54/0x90\n[    4.539159]  ? exc_invalid_op+0x17/0x70\n[    4.542999]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.547186]  ? __flush_work+0x2d6/0x300\n[    4.551027]  cancel_delayed_work_sync+0x5c/0x80\n[    4.555561]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.560098]  amdgpu_ring_alloc+0x3e/0x60\n[    4.564026]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.569167]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.573614]  amdgpu_device_init+0x1e4f/0x2530\n[    4.577974]  amdgpu_driver_load_kms+0x14/0x80\n[    4.582334]  amdgpu_pci_probe+0x150/0x490\n[    4.586350]  local_pci_probe+0x3d/0x90\n[    4.590103]  pci_device_probe+0xb5/0x180\n[    4.594032]  really_probe+0xcc/0x2b0\n[    4.597611]  ? __pfx___driver_attach+0x10/0x10\n[    4.602063]  __driver_probe_device+0x6e/0x110\n[    4.606423]  driver_probe_device+0x1a/0xe0\n[    4.610523]  __driver_attach+0x83/0x180\n[    4.614361]  bus_for_each_dev+0x83/0xd0\n[    4.618199]  bus_add_driver+0xe3/0x210\n[    4.621952]  driver_register+0x54/0x100\n[    4.625791]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.629891]  do_one_initcall+0x56/0x220\n[    4.633734]  kernel_init_freeable+0x19e/0x2d0\n[    4.638094]  ? __pfx_kernel_init+0x10/0x10\n[    4.642192]  kernel_init+0x15/0x1c0\n[    4.645685]  ret_from_fork+0x2f/0x50\n[    4.649265]  ? __pfx_kernel_init+0x10/0x10\n[    4.653363]  ret_from_fork_asm+0x1a/0x30\n[    4.657293]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_lid_angle', 'cros_ec_sensorhub', 'cros_ec_sensors', 'cros_ec_sensors_core', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.886826] WARNING: CPU: 0 PID: 62 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.886837] Modules linked in: btusb btrtl cros_ec_sensors cros_ec_lid_angle btintel cros_ec_sensors_core btbcm snd_acp3x_pcm_dma snd_acp3x_i2s btmtk bluetooth cros_ec_sysfs cros_ec_hwmon cros_ec_debugfs cros_ec_chardev cros_usbpd_logger cros_usbpd_charger cros_charge_control cros_ec_sensorhub snd_sof_amd_rembrandt snd_soc_acp_rt5682_mach snd_sof_amd_renoir snd_soc_rt5682_i2c snd_sof_amd_acp gsmi snd_acp_config snd_soc_rt5682 snd_sof_pci snd_soc_rl6231 snd_sof_xtensa_dsp regmap_i2c sp5100_tco memconsole_coreboot snd_sof acpi_als snd_sof_utils snd_soc_acpi industrialio_triggered_buffer watchdog cros_ec_typec snd_soc_acp_da7219mx98357_mach snd_soc_max98357a roles cros_ec_dev snd_pci_acp3x iwlmvm kfifo_buf iwlwifi i2c_piix4 typec snd_soc_cros_ec_codec acp_audio_dma i2c_cros_ec_tunnel cros_usbpd_notify industrialio vpd_sysfs memconsole snd_soc_core i2c_hid_acpi elan_i2c i2c_hid snd_compress snd_pcm_dmaengine chromeos_pstore cros_kbd_led_backlight coreboot_table\n[    6.886933] CPU: 0 UID: 0 PID: 62 Comm: kworker/0:2 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.886939] Tainted: [W]=WARN\n[    6.886941] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    6.886943] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.886950] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.886956] Code: 70 9e 97 6d 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886959] RSP: 0018:ffffa64b80253c70 EFLAGS: 00010246\n[    6.886963] RAX: 0000000000000000 RBX: ffff8c75039388e8 RCX: 0000000000000000\n[    6.886966] RDX: ffffa64b80253c78 RSI: 0000000000000001 RDI: ffffa64b80253cc0\n[    6.886968] RBP: ffff8c75039388e8 R08: ffffa64b80253df0 R09: 0000000000000000\n[    6.886970] R10: ffffa64b80253b38 R11: 0000000000000005 R12: 00000000000003e8\n[    6.886972] R13: 0000000000000001 R14: ffff8c7503900000 R15: ffff8c75039323c0\n[    6.886975] FS:  0000000000000000(0000) GS:ffff8c752ae00000(0000) knlGS:0000000000000000\n[    6.886978] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.886980] CR2: 0000558a35e47108 CR3: 000000010497e000 CR4: 00000000003506f0\n[    6.886983] Call Trace:\n[    6.886985]  <TASK>\n[    6.886988]  ? __warn+0x84/0x130\n[    6.886993]  ? __flush_work+0x2d6/0x300\n[    6.886998]  ? report_bug+0x164/0x190\n[    6.887006]  ? handle_bug+0x54/0x90\n[    6.887010]  ? exc_invalid_op+0x17/0x70\n[    6.887014]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.887023]  ? __flush_work+0x2d6/0x300\n[    6.887031]  cancel_delayed_work_sync+0x5c/0x80\n[    6.887036]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.887044]  amdgpu_ring_alloc+0x3e/0x60\n[    6.887049]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.887057]  amdgpu_job_submit_direct+0x2c/0x50\n[    6.887063]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    6.887069]  amdgpu_ib_ring_tests+0x105/0x170\n[    6.887075]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    6.887078]  process_one_work+0x163/0x390\n[    6.887084]  worker_thread+0x2a0/0x3b0\n[    6.887088]  ? __pfx_worker_thread+0x10/0x10\n[    6.887093]  ? __pfx_worker_thread+0x10/0x10\n[    6.887097]  kthread+0xcb/0xf0\n[    6.887102]  ? __pfx_kthread+0x10/0x10\n[    6.887106]  ret_from_fork+0x2f/0x50\n[    6.887110]  ? __pfx_kthread+0x10/0x10\n[    6.887114]  ret_from_fork_asm+0x1a/0x30\n[    6.887123]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:feef826d4118edf136d1284f7a59a2146657372d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:feef826d4118edf136d1284f7a59a2146657372d', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406e9f11fb139cb87e12ee', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 01:53:37 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406e9f11fb139cb87e12ee
11/22/2024 01:53:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:37 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 01:53:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feef826d4118edf136d1284f7a59a2146657372d
11/22/2024 01:53:37 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:feef826d4118edf136d1284f7a59a2146657372d
11/22/2024 01:53:57 PM UTC [INFO] Received an event for node: 67408cf511fb139cb87e30f3
11/22/2024 01:53:57 PM UTC [DEBUG] Not sending node to KCIDB: 67408cf511fb139cb87e30f3
11/22/2024 01:53:57 PM UTC [INFO] Received an event for node: 67406d0111fb139cb87dfa46
11/22/2024 01:53:58 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0111fb139cb87dfa46
11/22/2024 01:53:58 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0111fb139cb87dfa46
11/22/2024 01:54:03 PM UTC [INFO] Received an event for node: 67408cfb11fb139cb87e30f6
11/22/2024 01:54:03 PM UTC [DEBUG] Not sending node to KCIDB: 67408cfb11fb139cb87e30f6
11/22/2024 01:54:03 PM UTC [INFO] Received an event for node: 67406ea111fb139cb87e135c
11/22/2024 01:54:04 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e135c
11/22/2024 01:54:04 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e135c
11/22/2024 01:54:27 PM UTC [INFO] Received an event for node: 67408d1311fb139cb87e30f9
11/22/2024 01:54:27 PM UTC [DEBUG] Not sending node to KCIDB: 67408d1311fb139cb87e30f9
11/22/2024 01:54:27 PM UTC [INFO] Received an event for node: 67406ea111fb139cb87e13a6
11/22/2024 01:54:28 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a6
11/22/2024 01:54:28 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a6
11/22/2024 01:54:28 PM UTC [INFO] Received an event for node: 67408d1411fb139cb87e30fc
11/22/2024 01:54:28 PM UTC [DEBUG] Not sending node to KCIDB: 67408d1411fb139cb87e30fc
11/22/2024 01:54:28 PM UTC [INFO] Received an event for node: 67406ea111fb139cb87e13a8
11/22/2024 01:54:29 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a8
11/22/2024 01:54:29 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a8
11/22/2024 01:54:29 PM UTC [INFO] Received an event for node: 67408d1511fb139cb87e30ff
11/22/2024 01:54:29 PM UTC [DEBUG] Not sending node to KCIDB: 67408d1511fb139cb87e30ff
11/22/2024 01:54:29 PM UTC [INFO] Received an event for node: 67406ea111fb139cb87e13a9
11/22/2024 01:54:30 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea111fb139cb87e13a9
11/22/2024 01:54:30 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea111fb139cb87e13a9
11/22/2024 01:54:50 PM UTC [INFO] Received an event for node: 67408d2a11fb139cb87e3102
11/22/2024 01:54:50 PM UTC [DEBUG] Not sending node to KCIDB: 67408d2a11fb139cb87e3102
11/22/2024 01:54:50 PM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa6a
11/22/2024 01:54:50 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0711fb139cb87dfa6a
11/22/2024 01:54:50 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa6a
11/22/2024 01:54:55 PM UTC [INFO] Received an event for node: 67408d2f11fb139cb87e3105
11/22/2024 01:54:55 PM UTC [DEBUG] Not sending node to KCIDB: 67408d2f11fb139cb87e3105
11/22/2024 01:54:55 PM UTC [INFO] Received an event for node: 67406ea211fb139cb87e13e2
11/22/2024 01:54:56 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e13e2
11/22/2024 01:54:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e13e2
11/22/2024 01:55:18 PM UTC [INFO] Received an event for node: 67408d4611fb139cb87e3108
11/22/2024 01:55:18 PM UTC [DEBUG] Not sending node to KCIDB: 67408d4611fb139cb87e3108
11/22/2024 01:55:18 PM UTC [INFO] Received an event for node: 67406ea211fb139cb87e146e
11/22/2024 01:55:19 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e146e
11/22/2024 01:55:19 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e146e
11/22/2024 01:55:20 PM UTC [INFO] Received an event for node: 67408d4811fb139cb87e310b
11/22/2024 01:55:20 PM UTC [DEBUG] Not sending node to KCIDB: 67408d4811fb139cb87e310b
11/22/2024 01:55:20 PM UTC [INFO] Received an event for node: 67406ea211fb139cb87e1475
11/22/2024 01:55:21 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1475
11/22/2024 01:55:21 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1475
11/22/2024 01:55:21 PM UTC [INFO] Received an event for node: 67408d4811fb139cb87e310e
11/22/2024 01:55:21 PM UTC [DEBUG] Not sending node to KCIDB: 67408d4811fb139cb87e310e
11/22/2024 01:55:21 PM UTC [INFO] Received an event for node: 67406ea211fb139cb87e1477
11/22/2024 01:55:22 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ea211fb139cb87e1477
11/22/2024 01:55:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ea211fb139cb87e1477
11/22/2024 02:18:40 PM UTC [INFO] Received an event for node: 6740688411fb139cb87df65e
11/22/2024 02:18:40 PM UTC [DEBUG] Sending to KCIDB: checkouts: maestro:6740688411fb139cb87df65e
11/22/2024 02:41:47 PM UTC [INFO] Received an event for node: 6725274d2900664149efcc39
11/22/2024 02:41:47 PM UTC [DEBUG] Not sending node to KCIDB: 6725274d2900664149efcc39
11/22/2024 02:41:47 PM UTC [INFO] Received an event for node: 67406ecb11fb139cb87e1984
11/22/2024 02:41:48 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecb11fb139cb87e1984
11/22/2024 02:41:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecb11fb139cb87e1984
11/22/2024 02:41:59 PM UTC [INFO] Received an event for node: 6740983711fb139cb87e3114
11/22/2024 02:41:59 PM UTC [DEBUG] Not sending node to KCIDB: 6740983711fb139cb87e3114
11/22/2024 02:41:59 PM UTC [INFO] Received an event for node: 67406d0311fb139cb87dfa52
11/22/2024 02:42:00 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d0311fb139cb87dfa52
11/22/2024 02:42:00 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0311fb139cb87dfa52
11/22/2024 02:42:05 PM UTC [INFO] Received an event for node: 6740983d11fb139cb87e3117
11/22/2024 02:42:05 PM UTC [DEBUG] Not sending node to KCIDB: 6740983d11fb139cb87e3117
11/22/2024 02:42:05 PM UTC [INFO] Received an event for node: 67406ecc11fb139cb87e198c
11/22/2024 02:42:06 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e198c
11/22/2024 02:42:06 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e198c
11/22/2024 02:42:32 PM UTC [INFO] Received an event for node: 6740985811fb139cb87e311a
11/22/2024 02:42:32 PM UTC [DEBUG] Not sending node to KCIDB: 6740985811fb139cb87e311a
11/22/2024 02:42:32 PM UTC [INFO] Received an event for node: 67406ecc11fb139cb87e1a00
11/22/2024 02:42:33 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a00
11/22/2024 02:42:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a00
11/22/2024 02:42:33 PM UTC [INFO] Received an event for node: 6740985911fb139cb87e311d
11/22/2024 02:42:33 PM UTC [DEBUG] Not sending node to KCIDB: 6740985911fb139cb87e311d
11/22/2024 02:42:33 PM UTC [INFO] Received an event for node: 67406ecc11fb139cb87e1a08
11/22/2024 02:42:34 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a08
11/22/2024 02:42:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a08
11/22/2024 02:42:34 PM UTC [INFO] Received an event for node: 6740985911fb139cb87e3120
11/22/2024 02:42:34 PM UTC [DEBUG] Not sending node to KCIDB: 6740985911fb139cb87e3120
11/22/2024 02:42:34 PM UTC [INFO] Received an event for node: 67406ecc11fb139cb87e1a0a
11/22/2024 02:42:35 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406ecc11fb139cb87e1a0a
11/22/2024 02:42:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ecc11fb139cb87e1a0a
11/22/2024 02:50:42 PM UTC [INFO] Received an event for node: 674045ba7b0bd642f4da0746
11/22/2024 02:50:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674045ba7b0bd642f4da0746
11/22/2024 03:00:42 PM UTC [INFO] Received an event for node: 670ead31591f49707a413d70
11/22/2024 03:00:42 PM UTC [DEBUG] Not sending node to KCIDB: 670ead31591f49707a413d70
11/22/2024 03:00:42 PM UTC [INFO] Received an event for node: 67406d2b11fb139cb87dfb39
11/22/2024 03:00:43 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.931000] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.938748] Modules linked in:\n[    4.941809] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.949553] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.958251] EIP: __flush_work+0xb8/0xd0\n[    4.962103] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.980851] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    4.987117] ESI: c26aeea8 EDI: c2680000 EBP: c23f1be8 ESP: c23f1b80\n[    4.993385] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.000173] CR0: 80050033 CR2: 00000000 CR3: 1a558000 CR4: 003506d0\n[    5.006441] Call Trace:\n[    5.008894]  ? show_regs+0x51/0x58\n[    5.012302]  ? __flush_work+0xb8/0xd0\n[    5.015971]  ? __warn+0x8d/0x1b8\n[    5.019206]  ? __flush_work+0xb8/0xd0\n[    5.022878]  ? __flush_work+0xb8/0xd0\n[    5.026547]  ? report_bug+0x186/0x1b0\n[    5.030217]  ? __flush_work+0xb9/0xd0\n[    5.033885]  ? exc_overflow+0x50/0x50\n[    5.037555]  ? handle_bug+0x56/0x90\n[    5.041050]  ? exc_invalid_op+0x1d/0x70\n[    5.044891]  ? handle_exception+0x14b/0x14b\n[    5.049083]  ? exc_overflow+0x50/0x50\n[    5.052752]  ? __flush_work+0xb8/0xd0\n[    5.056420]  ? exc_overflow+0x50/0x50\n[    5.060088]  ? __flush_work+0xb8/0xd0\n[    5.063764]  cancel_delayed_work_sync+0x88/0x90\n[    5.068302]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.072838]  ? amdgpu_device_rreg+0x40/0x64\n[    5.077029]  amdgpu_ring_alloc+0x46/0x5c\n[    5.080957]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.086103]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.091595]  amdgpu_ring_test_helper+0x20/0x90\n[    5.096043]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.099884]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.104333]  amdgpu_device_init+0xc4a/0x1458\n[    5.108609]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.112970]  amdgpu_pci_probe+0x153/0x570\n[    5.116986]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.121955]  pci_device_probe+0x8c/0x118\n[    5.125883]  ? sysfs_create_link+0x1d/0x38\n[    5.129987]  really_probe+0xc2/0x2ac\n[    5.133569]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.137936]  ? pm_runtime_barrier+0x52/0x90\n[    5.142133]  __driver_probe_device+0x7a/0x180\n[    5.146494]  ? lock_release+0x6c/0x140\n[    5.150255]  driver_probe_device+0x23/0x108\n[    5.154444]  __driver_attach+0x97/0x188\n[    5.158286]  ? __device_attach_driver+0x120/0x120\n[    5.162994]  bus_for_each_dev+0x71/0xc0\n[    5.166835]  driver_attach+0x19/0x20\n[    5.170421]  ? __device_attach_driver+0x120/0x120\n[    5.175131]  bus_add_driver+0xc9/0x208\n[    5.178886]  driver_register+0x52/0x10c\n[    5.182728]  __pci_register_driver+0x5f/0x68\n[    5.187004]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.191802]  amdgpu_init+0x62/0xb0\n[    5.195210]  do_one_initcall+0x63/0x2a4\n[    5.199051]  ? rdinit_setup+0x40/0x40\n[    5.202719]  ? parse_args+0x14b/0x3f4\n[    5.206393]  do_initcalls+0xdc/0x218\n[    5.209975]  ? rdinit_setup+0x40/0x40\n[    5.213647]  kernel_init_freeable+0x16b/0x2bc\n[    5.218010]  ? kernel_init+0x18/0x1f4\n[    5.221677]  ? rest_init+0x1cc/0x1cc\n[    5.225259]  kernel_init+0x18/0x1f4\n[    5.228752]  ? schedule_tail+0x50/0x60\n[    5.232508]  ret_from_fork+0x38/0x44\n[    5.236089]  ? rest_init+0x1cc/0x1cc\n[    5.239669]  ret_from_fork_asm+0x12/0x18\n[    5.243598]  entry_INT80_32+0x108/0x108\n[    5.247442] irq event stamp: 846607\n[    5.250934] hardirqs last  enabled at (846617): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    5.258938] hardirqs last disabled at (846626): [<d6e09055>] __up_console_sem+0x39/0x58\n[    5.266939] softirqs last  enabled at (846514): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    5.275033] softirqs last disabled at (846645): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.516909] WARNING: CPU: 2 PID: 48 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.524761] Modules linked in:\n[    8.527830] CPU: 2 UID: 0 PID: 48 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.537317] Tainted: [W]=WARN\n[    8.540303] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    8.549008] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.555464] EIP: __flush_work+0xb8/0xd0\n[    8.559317] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.578078] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    8.584357] ESI: c26aeea8 EDI: c27ba17c EBP: c19edd64 ESP: c19edcfc\n[    8.590633] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.597430] CR0: 80050033 CR2: b7e38680 CR3: 1a558000 CR4: 003506d0\n[    8.603705] Call Trace:\n[    8.606169]  ? show_regs+0x51/0x58\n[    8.609589]  ? __flush_work+0xb8/0xd0\n[    8.613267]  ? __warn+0x8d/0x1b8\n[    8.616511]  ? __flush_work+0xb8/0xd0\n[    8.620190]  ? __flush_work+0xb8/0xd0\n[    8.623864]  ? report_bug+0x186/0x1b0\n[    8.627546]  ? __flush_work+0xb9/0xd0\n[    8.631222]  ? exc_overflow+0x50/0x50\n[    8.634900]  ? handle_bug+0x56/0x90\n[    8.638409]  ? exc_invalid_op+0x1d/0x70\n[    8.642264]  ? handle_exception+0x14b/0x14b\n[    8.646467]  ? exc_overflow+0x50/0x50\n[    8.650153]  ? __flush_work+0xb8/0xd0\n[    8.653832]  ? exc_overflow+0x50/0x50\n[    8.657512]  ? __flush_work+0xb8/0xd0\n[    8.661194]  cancel_delayed_work_sync+0x88/0x90\n[    8.665740]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.670293]  amdgpu_ring_alloc+0x46/0x5c\n[    8.674236]  amdgpu_ib_schedule+0x14b/0x898\n[    8.678441]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.682999]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.688587]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.693568]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.698980]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.703359]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.709210]  process_one_work+0x1b9/0x6f0\n[    8.713238]  ? process_one_work+0x16c/0x6f0\n[    8.717442]  worker_thread+0x168/0x304\n[    8.721209]  kthread+0xcc/0xf4\n[    8.724278]  ? rescuer_thread+0x33c/0x33c\n[    8.728302]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.733715]  ret_from_fork+0x38/0x44\n[    8.737310]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.742723]  ret_from_fork_asm+0x12/0x18\n[    8.746660]  entry_INT80_32+0x108/0x108\n[    8.750515] irq event stamp: 22323\n[    8.753933] hardirqs last  enabled at (22357): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    8.761863] hardirqs last disabled at (22390): [<d6e09055>] __up_console_sem+0x39/0x58\n[    8.769790] softirqs last  enabled at (22422): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    8.777804] softirqs last disabled at (22435): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:df8d7661295be7f290db5f8dd5360c49758a5b37', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:57ff41ebb22c42abc22133d0651cd37fa62b5a6a', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406d2b11fb139cb87dfb39', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d2b11fb139cb87dfb39
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:df8d7661295be7f290db5f8dd5360c49758a5b37
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a5ce82df4dcf96232250cfa7c2c1a16a2913eee4
11/22/2024 03:00:43 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:57ff41ebb22c42abc22133d0651cd37fa62b5a6a
11/22/2024 03:00:55 PM UTC [INFO] Received an event for node: 670ead38591f49707a413d86
11/22/2024 03:00:55 PM UTC [DEBUG] Not sending node to KCIDB: 670ead38591f49707a413d86
11/22/2024 03:00:55 PM UTC [INFO] Received an event for node: 67406ed311fb139cb87e1c30
11/22/2024 03:00:56 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.931000] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.938748] Modules linked in:\n[    4.941809] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.949553] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.958251] EIP: __flush_work+0xb8/0xd0\n[    4.962103] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.980851] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    4.987117] ESI: c26aeea8 EDI: c2680000 EBP: c23f1be8 ESP: c23f1b80\n[    4.993385] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.000173] CR0: 80050033 CR2: 00000000 CR3: 1a558000 CR4: 003506d0\n[    5.006441] Call Trace:\n[    5.008894]  ? show_regs+0x51/0x58\n[    5.012302]  ? __flush_work+0xb8/0xd0\n[    5.015971]  ? __warn+0x8d/0x1b8\n[    5.019206]  ? __flush_work+0xb8/0xd0\n[    5.022878]  ? __flush_work+0xb8/0xd0\n[    5.026547]  ? report_bug+0x186/0x1b0\n[    5.030217]  ? __flush_work+0xb9/0xd0\n[    5.033885]  ? exc_overflow+0x50/0x50\n[    5.037555]  ? handle_bug+0x56/0x90\n[    5.041050]  ? exc_invalid_op+0x1d/0x70\n[    5.044891]  ? handle_exception+0x14b/0x14b\n[    5.049083]  ? exc_overflow+0x50/0x50\n[    5.052752]  ? __flush_work+0xb8/0xd0\n[    5.056420]  ? exc_overflow+0x50/0x50\n[    5.060088]  ? __flush_work+0xb8/0xd0\n[    5.063764]  cancel_delayed_work_sync+0x88/0x90\n[    5.068302]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.072838]  ? amdgpu_device_rreg+0x40/0x64\n[    5.077029]  amdgpu_ring_alloc+0x46/0x5c\n[    5.080957]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.086103]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.091595]  amdgpu_ring_test_helper+0x20/0x90\n[    5.096043]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.099884]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.104333]  amdgpu_device_init+0xc4a/0x1458\n[    5.108609]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.112970]  amdgpu_pci_probe+0x153/0x570\n[    5.116986]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.121955]  pci_device_probe+0x8c/0x118\n[    5.125883]  ? sysfs_create_link+0x1d/0x38\n[    5.129987]  really_probe+0xc2/0x2ac\n[    5.133569]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.137936]  ? pm_runtime_barrier+0x52/0x90\n[    5.142133]  __driver_probe_device+0x7a/0x180\n[    5.146494]  ? lock_release+0x6c/0x140\n[    5.150255]  driver_probe_device+0x23/0x108\n[    5.154444]  __driver_attach+0x97/0x188\n[    5.158286]  ? __device_attach_driver+0x120/0x120\n[    5.162994]  bus_for_each_dev+0x71/0xc0\n[    5.166835]  driver_attach+0x19/0x20\n[    5.170421]  ? __device_attach_driver+0x120/0x120\n[    5.175131]  bus_add_driver+0xc9/0x208\n[    5.178886]  driver_register+0x52/0x10c\n[    5.182728]  __pci_register_driver+0x5f/0x68\n[    5.187004]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.191802]  amdgpu_init+0x62/0xb0\n[    5.195210]  do_one_initcall+0x63/0x2a4\n[    5.199051]  ? rdinit_setup+0x40/0x40\n[    5.202719]  ? parse_args+0x14b/0x3f4\n[    5.206393]  do_initcalls+0xdc/0x218\n[    5.209975]  ? rdinit_setup+0x40/0x40\n[    5.213647]  kernel_init_freeable+0x16b/0x2bc\n[    5.218010]  ? kernel_init+0x18/0x1f4\n[    5.221677]  ? rest_init+0x1cc/0x1cc\n[    5.225259]  kernel_init+0x18/0x1f4\n[    5.228752]  ? schedule_tail+0x50/0x60\n[    5.232508]  ret_from_fork+0x38/0x44\n[    5.236089]  ? rest_init+0x1cc/0x1cc\n[    5.239669]  ret_from_fork_asm+0x12/0x18\n[    5.243598]  entry_INT80_32+0x108/0x108\n[    5.247442] irq event stamp: 846607\n[    5.250934] hardirqs last  enabled at (846617): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    5.258938] hardirqs last disabled at (846626): [<d6e09055>] __up_console_sem+0x39/0x58\n[    5.266939] softirqs last  enabled at (846514): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    5.275033] softirqs last disabled at (846645): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.516909] WARNING: CPU: 2 PID: 48 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.524761] Modules linked in:\n[    8.527830] CPU: 2 UID: 0 PID: 48 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.537317] Tainted: [W]=WARN\n[    8.540303] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    8.549008] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.555464] EIP: __flush_work+0xb8/0xd0\n[    8.559317] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.578078] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    8.584357] ESI: c26aeea8 EDI: c27ba17c EBP: c19edd64 ESP: c19edcfc\n[    8.590633] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.597430] CR0: 80050033 CR2: b7e38680 CR3: 1a558000 CR4: 003506d0\n[    8.603705] Call Trace:\n[    8.606169]  ? show_regs+0x51/0x58\n[    8.609589]  ? __flush_work+0xb8/0xd0\n[    8.613267]  ? __warn+0x8d/0x1b8\n[    8.616511]  ? __flush_work+0xb8/0xd0\n[    8.620190]  ? __flush_work+0xb8/0xd0\n[    8.623864]  ? report_bug+0x186/0x1b0\n[    8.627546]  ? __flush_work+0xb9/0xd0\n[    8.631222]  ? exc_overflow+0x50/0x50\n[    8.634900]  ? handle_bug+0x56/0x90\n[    8.638409]  ? exc_invalid_op+0x1d/0x70\n[    8.642264]  ? handle_exception+0x14b/0x14b\n[    8.646467]  ? exc_overflow+0x50/0x50\n[    8.650153]  ? __flush_work+0xb8/0xd0\n[    8.653832]  ? exc_overflow+0x50/0x50\n[    8.657512]  ? __flush_work+0xb8/0xd0\n[    8.661194]  cancel_delayed_work_sync+0x88/0x90\n[    8.665740]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.670293]  amdgpu_ring_alloc+0x46/0x5c\n[    8.674236]  amdgpu_ib_schedule+0x14b/0x898\n[    8.678441]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.682999]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.688587]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.693568]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.698980]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.703359]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.709210]  process_one_work+0x1b9/0x6f0\n[    8.713238]  ? process_one_work+0x16c/0x6f0\n[    8.717442]  worker_thread+0x168/0x304\n[    8.721209]  kthread+0xcc/0xf4\n[    8.724278]  ? rescuer_thread+0x33c/0x33c\n[    8.728302]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.733715]  ret_from_fork+0x38/0x44\n[    8.737310]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.742723]  ret_from_fork_asm+0x12/0x18\n[    8.746660]  entry_INT80_32+0x108/0x108\n[    8.750515] irq event stamp: 22323\n[    8.753933] hardirqs last  enabled at (22357): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    8.761863] hardirqs last disabled at (22390): [<d6e09055>] __up_console_sem+0x39/0x58\n[    8.769790] softirqs last  enabled at (22422): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    8.777804] softirqs last disabled at (22435): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:012cc53281e0c5148028915fc1a19beab75f8e4d', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7632295d68e5c66ad6174ea5fb7194643d1f79c1', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7632295d68e5c66ad6174ea5fb7194643d1f79c1', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5290a9d85629a42b954538ca05d90def0c942010', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c30', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ed311fb139cb87e1c30
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:012cc53281e0c5148028915fc1a19beab75f8e4d
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7632295d68e5c66ad6174ea5fb7194643d1f79c1
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7632295d68e5c66ad6174ea5fb7194643d1f79c1
11/22/2024 03:00:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5290a9d85629a42b954538ca05d90def0c942010
11/22/2024 03:01:06 PM UTC [INFO] Received an event for node: 670ead3c591f49707a413d87
11/22/2024 03:01:06 PM UTC [DEBUG] Not sending node to KCIDB: 670ead3c591f49707a413d87
11/22/2024 03:01:06 PM UTC [INFO] Received an event for node: 67406ed311fb139cb87e1c31
11/22/2024 03:01:07 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', '? amdgpu_device_rreg+0x40/0x64', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0', '? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108', 'amdgpu_ring_test_helper+0x20/0x90', 'vcn_v1_0_hw_init+0x67/0x7c', 'amdgpu_device_ip_init+0x5c5/0xa74', 'amdgpu_device_init+0xc4a/0x1458', 'amdgpu_driver_load_kms+0x19/0x9c', 'amdgpu_pci_probe+0x153/0x570', '? _raw_spin_unlock_irqrestore+0x2f/0x58', 'pci_device_probe+0x8c/0x118', '? sysfs_create_link+0x1d/0x38', 'really_probe+0xc2/0x2ac', '? _raw_spin_unlock_irq+0x1d/0x38', '? pm_runtime_barrier+0x52/0x90', '__driver_probe_device+0x7a/0x180', '? lock_release+0x6c/0x140', 'driver_probe_device+0x23/0x108', '__driver_attach+0x97/0x188', '? __device_attach_driver+0x120/0x120', 'bus_for_each_dev+0x71/0xc0', 'driver_attach+0x19/0x20', '? __device_attach_driver+0x120/0x120', 'bus_add_driver+0xc9/0x208', 'driver_register+0x52/0x10c', '__pci_register_driver+0x5f/0x68', '? drm_sched_fence_slab_init+0x80/0x80', 'amdgpu_init+0x62/0xb0', 'do_one_initcall+0x63/0x2a4', '? rdinit_setup+0x40/0x40', '? parse_args+0x14b/0x3f4', 'do_initcalls+0xdc/0x218', '? rdinit_setup+0x40/0x40', 'kernel_init_freeable+0x16b/0x2bc', '? kernel_init+0x18/0x1f4', '? rest_init+0x1cc/0x1cc', 'kernel_init+0x18/0x1f4', '? schedule_tail+0x50/0x60', 'ret_from_fork+0x38/0x44', '? rest_init+0x1cc/0x1cc', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    4.931000] WARNING: CPU: 2 PID: 1 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    4.938748] Modules linked in:\n[    4.941809] CPU: 2 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.949553] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    4.958251] EIP: __flush_work+0xb8/0xd0\n[    4.962103] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    4.980851] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    4.987117] ESI: c26aeea8 EDI: c2680000 EBP: c23f1be8 ESP: c23f1b80\n[    4.993385] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    5.000173] CR0: 80050033 CR2: 00000000 CR3: 1a558000 CR4: 003506d0\n[    5.006441] Call Trace:\n[    5.008894]  ? show_regs+0x51/0x58\n[    5.012302]  ? __flush_work+0xb8/0xd0\n[    5.015971]  ? __warn+0x8d/0x1b8\n[    5.019206]  ? __flush_work+0xb8/0xd0\n[    5.022878]  ? __flush_work+0xb8/0xd0\n[    5.026547]  ? report_bug+0x186/0x1b0\n[    5.030217]  ? __flush_work+0xb9/0xd0\n[    5.033885]  ? exc_overflow+0x50/0x50\n[    5.037555]  ? handle_bug+0x56/0x90\n[    5.041050]  ? exc_invalid_op+0x1d/0x70\n[    5.044891]  ? handle_exception+0x14b/0x14b\n[    5.049083]  ? exc_overflow+0x50/0x50\n[    5.052752]  ? __flush_work+0xb8/0xd0\n[    5.056420]  ? exc_overflow+0x50/0x50\n[    5.060088]  ? __flush_work+0xb8/0xd0\n[    5.063764]  cancel_delayed_work_sync+0x88/0x90\n[    5.068302]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    5.072838]  ? amdgpu_device_rreg+0x40/0x64\n[    5.077029]  amdgpu_ring_alloc+0x46/0x5c\n[    5.080957]  amdgpu_jpeg_dec_ring_test_ring+0x3c/0x2b0\n[    5.086103]  ? amdgpu_vcn_dec_sw_ring_test_ring+0xdc/0x108\n[    5.091595]  amdgpu_ring_test_helper+0x20/0x90\n[    5.096043]  vcn_v1_0_hw_init+0x67/0x7c\n[    5.099884]  amdgpu_device_ip_init+0x5c5/0xa74\n[    5.104333]  amdgpu_device_init+0xc4a/0x1458\n[    5.108609]  amdgpu_driver_load_kms+0x19/0x9c\n[    5.112970]  amdgpu_pci_probe+0x153/0x570\n[    5.116986]  ? _raw_spin_unlock_irqrestore+0x2f/0x58\n[    5.121955]  pci_device_probe+0x8c/0x118\n[    5.125883]  ? sysfs_create_link+0x1d/0x38\n[    5.129987]  really_probe+0xc2/0x2ac\n[    5.133569]  ? _raw_spin_unlock_irq+0x1d/0x38\n[    5.137936]  ? pm_runtime_barrier+0x52/0x90\n[    5.142133]  __driver_probe_device+0x7a/0x180\n[    5.146494]  ? lock_release+0x6c/0x140\n[    5.150255]  driver_probe_device+0x23/0x108\n[    5.154444]  __driver_attach+0x97/0x188\n[    5.158286]  ? __device_attach_driver+0x120/0x120\n[    5.162994]  bus_for_each_dev+0x71/0xc0\n[    5.166835]  driver_attach+0x19/0x20\n[    5.170421]  ? __device_attach_driver+0x120/0x120\n[    5.175131]  bus_add_driver+0xc9/0x208\n[    5.178886]  driver_register+0x52/0x10c\n[    5.182728]  __pci_register_driver+0x5f/0x68\n[    5.187004]  ? drm_sched_fence_slab_init+0x80/0x80\n[    5.191802]  amdgpu_init+0x62/0xb0\n[    5.195210]  do_one_initcall+0x63/0x2a4\n[    5.199051]  ? rdinit_setup+0x40/0x40\n[    5.202719]  ? parse_args+0x14b/0x3f4\n[    5.206393]  do_initcalls+0xdc/0x218\n[    5.209975]  ? rdinit_setup+0x40/0x40\n[    5.213647]  kernel_init_freeable+0x16b/0x2bc\n[    5.218010]  ? kernel_init+0x18/0x1f4\n[    5.221677]  ? rest_init+0x1cc/0x1cc\n[    5.225259]  kernel_init+0x18/0x1f4\n[    5.228752]  ? schedule_tail+0x50/0x60\n[    5.232508]  ret_from_fork+0x38/0x44\n[    5.236089]  ? rest_init+0x1cc/0x1cc\n[    5.239669]  ret_from_fork_asm+0x12/0x18\n[    5.243598]  entry_INT80_32+0x108/0x108\n[    5.247442] irq event stamp: 846607\n[    5.250934] hardirqs last  enabled at (846617): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    5.258938] hardirqs last disabled at (846626): [<d6e09055>] __up_console_sem+0x39/0x58\n[    5.266939] softirqs last  enabled at (846514): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    5.275033] softirqs last disabled at (846645): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'hardware': 'LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'call_trace': ['? show_regs+0x51/0x58', '? __flush_work+0xb8/0xd0', '? __warn+0x8d/0x1b8', '? __flush_work+0xb8/0xd0', '? __flush_work+0xb8/0xd0', '? report_bug+0x186/0x1b0', '? __flush_work+0xb9/0xd0', '? exc_overflow+0x50/0x50', '? handle_bug+0x56/0x90', '? exc_invalid_op+0x1d/0x70', '? handle_exception+0x14b/0x14b', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', '? exc_overflow+0x50/0x50', '? __flush_work+0xb8/0xd0', 'cancel_delayed_work_sync+0x88/0x90', 'jpeg_v1_0_ring_begin_use+0x19/0xc8', 'amdgpu_ring_alloc+0x46/0x5c', 'amdgpu_ib_schedule+0x14b/0x898', 'amdgpu_job_submit_direct+0x2c/0x44', 'amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc', 'amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0', '? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0', 'amdgpu_ib_ring_tests+0x141/0x1c0', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x1b9/0x6f0', '? process_one_work+0x16c/0x6f0', 'worker_thread+0x168/0x304', 'kthread+0xcc/0xf4', '? rescuer_thread+0x33c/0x33c', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork+0x38/0x44', '? kthread_insert_work_sanity_check+0x60/0x60', 'ret_from_fork_asm+0x12/0x18', 'entry_INT80_32+0x108/0x108'], 'log_excerpt': '[    8.516909] WARNING: CPU: 2 PID: 48 at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0\n[    8.524761] Modules linked in:\n[    8.527830] CPU: 2 UID: 0 PID: 48 Comm: kworker/2:1 Tainted: G        W          6.12.0-next-20241122 #1\n[    8.537317] Tainted: [W]=WARN\n[    8.540303] Hardware name: LENOVO Morphius/Morphius, BIOS Google_Morphius.13434.60.0 10/08/2020\n[    8.549008] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    8.555464] EIP: __flush_work+0xb8/0xd0\n[    8.559317] Code: 00 00 f3 90 8d 45 c0 e8 92 1d 04 00 84 c0 74 f2 eb d2 8d b4 26 00 00 00 00 90 0f 0b c6 45 9b 00 eb c2 8d b4 26 00 00 00 00 90 <0f> 0b eb ee 8d 74 26 00 0f 0b eb a6 8d 74 26 00 e8 af b4 8d 01 8d\n[    8.578078] EAX: 00000000 EBX: c26aee01 ECX: 00000001 EDX: 00000000\n[    8.584357] ESI: c26aeea8 EDI: c27ba17c EBP: c19edd64 ESP: c19edcfc\n[    8.590633] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246\n[    8.597430] CR0: 80050033 CR2: b7e38680 CR3: 1a558000 CR4: 003506d0\n[    8.603705] Call Trace:\n[    8.606169]  ? show_regs+0x51/0x58\n[    8.609589]  ? __flush_work+0xb8/0xd0\n[    8.613267]  ? __warn+0x8d/0x1b8\n[    8.616511]  ? __flush_work+0xb8/0xd0\n[    8.620190]  ? __flush_work+0xb8/0xd0\n[    8.623864]  ? report_bug+0x186/0x1b0\n[    8.627546]  ? __flush_work+0xb9/0xd0\n[    8.631222]  ? exc_overflow+0x50/0x50\n[    8.634900]  ? handle_bug+0x56/0x90\n[    8.638409]  ? exc_invalid_op+0x1d/0x70\n[    8.642264]  ? handle_exception+0x14b/0x14b\n[    8.646467]  ? exc_overflow+0x50/0x50\n[    8.650153]  ? __flush_work+0xb8/0xd0\n[    8.653832]  ? exc_overflow+0x50/0x50\n[    8.657512]  ? __flush_work+0xb8/0xd0\n[    8.661194]  cancel_delayed_work_sync+0x88/0x90\n[    8.665740]  jpeg_v1_0_ring_begin_use+0x19/0xc8\n[    8.670293]  amdgpu_ring_alloc+0x46/0x5c\n[    8.674236]  amdgpu_ib_schedule+0x14b/0x898\n[    8.678441]  amdgpu_job_submit_direct+0x2c/0x44\n[    8.682999]  amdgpu_jpeg_dec_set_reg.constprop.0+0xcd/0x1dc\n[    8.688587]  amdgpu_jpeg_dec_ring_test_ib+0x2b/0x1b0\n[    8.693568]  ? amdgpu_jpeg_dec_ring_test_ring+0x2b0/0x2b0\n[    8.698980]  amdgpu_ib_ring_tests+0x141/0x1c0\n[    8.703359]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    8.709210]  process_one_work+0x1b9/0x6f0\n[    8.713238]  ? process_one_work+0x16c/0x6f0\n[    8.717442]  worker_thread+0x168/0x304\n[    8.721209]  kthread+0xcc/0xf4\n[    8.724278]  ? rescuer_thread+0x33c/0x33c\n[    8.728302]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.733715]  ret_from_fork+0x38/0x44\n[    8.737310]  ? kthread_insert_work_sanity_check+0x60/0x60\n[    8.742723]  ret_from_fork_asm+0x12/0x18\n[    8.746660]  entry_INT80_32+0x108/0x108\n[    8.750515] irq event stamp: 22323\n[    8.753933] hardirqs last  enabled at (22357): [<d6e0906e>] __up_console_sem+0x52/0x58\n[    8.761863] hardirqs last disabled at (22390): [<d6e09055>] __up_console_sem+0x39/0x58\n[    8.769790] softirqs last  enabled at (22422): [<d6d835b2>] handle_softirqs+0x2fe/0x41c\n[    8.777804] softirqs last disabled at (22435): [<d868da12>] __do_softirq+0xa/0xc\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0xb8/0xd0', 'location': 'kernel/workqueue.c:4192 __flush_work+0xb8/0xd0'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:05d7dd78f9b53368c3b172a5e8ffb2c841d9452e', 'issue_id': 'maestro:ae160f6f27192c3527b2e88faba35d85d27c285f', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b', 'issue_id': 'maestro:40848c749c9933acff636dfe352c300e9f5aa7ef', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:1c74a3e6ec816e721b5225d1afd7402794c8309f', 'issue_id': 'maestro:f7b45dad16b8c4a9e3c1a4b28ffaf584e1d89aa7', 'issue_version': 0, 'test_id': 'maestro:67406ed311fb139cb87e1c31', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ed311fb139cb87e1c31
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:40848c749c9933acff636dfe352c300e9f5aa7ef
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:05d7dd78f9b53368c3b172a5e8ffb2c841d9452e
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ab800d66b42964952a5d52f4d3bbda4ecdee63b
11/22/2024 03:01:07 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:1c74a3e6ec816e721b5225d1afd7402794c8309f
11/22/2024 03:01:15 PM UTC [INFO] Received an event for node: 67409cbb11fb139cb87e312a
11/22/2024 03:01:15 PM UTC [DEBUG] Not sending node to KCIDB: 67409cbb11fb139cb87e312a
11/22/2024 03:01:15 PM UTC [INFO] Received an event for node: 67406d0711fb139cb87dfa6d
11/22/2024 03:01:16 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:36e8bad841b4628f2be18846593a50467ab6f5be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:36e8bad841b4628f2be18846593a50467ab6f5be', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406d0711fb139cb87dfa6d', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:16 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d0711fb139cb87dfa6d
11/22/2024 03:01:16 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:16 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:16 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36e8bad841b4628f2be18846593a50467ab6f5be
11/22/2024 03:01:16 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:36e8bad841b4628f2be18846593a50467ab6f5be
11/22/2024 03:01:21 PM UTC [INFO] Received an event for node: 67409cc111fb139cb87e312d
11/22/2024 03:01:21 PM UTC [DEBUG] Not sending node to KCIDB: 67409cc111fb139cb87e312d
11/22/2024 03:01:21 PM UTC [INFO] Received an event for node: 67406ee211fb139cb87e1c38
11/22/2024 03:01:22 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:c0505fcac51c75699f10c035d2674f0626c53883', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c0505fcac51c75699f10c035d2674f0626c53883', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c38', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:22 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c38
11/22/2024 03:01:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:22 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0505fcac51c75699f10c035d2674f0626c53883
11/22/2024 03:01:22 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c0505fcac51c75699f10c035d2674f0626c53883
11/22/2024 03:01:45 PM UTC [INFO] Received an event for node: 67409cd911fb139cb87e3130
11/22/2024 03:01:45 PM UTC [DEBUG] Not sending node to KCIDB: 67409cd911fb139cb87e3130
11/22/2024 03:01:45 PM UTC [INFO] Received an event for node: 67406ee211fb139cb87e1c82
11/22/2024 03:01:46 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d21b6b65a4465c1c34a436de4036854a609f8d45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d21b6b65a4465c1c34a436de4036854a609f8d45', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c82', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c82
11/22/2024 03:01:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:46 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d21b6b65a4465c1c34a436de4036854a609f8d45
11/22/2024 03:01:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d21b6b65a4465c1c34a436de4036854a609f8d45
11/22/2024 03:01:46 PM UTC [INFO] Received an event for node: 67409cda11fb139cb87e3133
11/22/2024 03:01:46 PM UTC [DEBUG] Not sending node to KCIDB: 67409cda11fb139cb87e3133
11/22/2024 03:01:46 PM UTC [INFO] Received an event for node: 67406ee211fb139cb87e1c84
11/22/2024 03:01:47 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c84', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c84
11/22/2024 03:01:47 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:47 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:47 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967
11/22/2024 03:01:47 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:d469c2dc5bf9c2f650a683ac3e37b10204b43967
11/22/2024 03:01:47 PM UTC [INFO] Received an event for node: 67409cdb11fb139cb87e3136
11/22/2024 03:01:47 PM UTC [DEBUG] Not sending node to KCIDB: 67409cdb11fb139cb87e3136
11/22/2024 03:01:47 PM UTC [INFO] Received an event for node: 67406ee211fb139cb87e1c85
11/22/2024 03:01:48 PM UTC [DEBUG] Generated issues/incidents: {'issues': [{'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_jpeg_dec_ring_test_ring+0x30/0x180', 'amdgpu_ring_test_helper+0x1b/0x90', 'amdgpu_device_init+0x1e4f/0x2530', 'amdgpu_driver_load_kms+0x14/0x80', 'amdgpu_pci_probe+0x150/0x490', 'local_pci_probe+0x3d/0x90', 'pci_device_probe+0xb5/0x180', 'really_probe+0xcc/0x2b0', '? __pfx___driver_attach+0x10/0x10', '__driver_probe_device+0x6e/0x110', 'driver_probe_device+0x1a/0xe0', '__driver_attach+0x83/0x180', 'bus_for_each_dev+0x83/0xd0', 'bus_add_driver+0xe3/0x210', 'driver_register+0x54/0x100', '? __pfx_amdgpu_init+0x10/0x10', 'do_one_initcall+0x56/0x220', 'kernel_init_freeable+0x19e/0x2d0', '? __pfx_kernel_init+0x10/0x10', 'kernel_init+0x15/0x1c0', 'ret_from_fork+0x2f/0x50', '? __pfx_kernel_init+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'log_excerpt': '[    4.276057] WARNING: CPU: 1 PID: 1 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    4.283998] Modules linked in:\n[    4.287061] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-next-20241122 #1\n[    4.294817] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    4.304205] RIP: 0010:__flush_work+0x2d6/0x300\n[    4.308670] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    4.327420] RSP: 0018:ffffb47180037b30 EFLAGS: 00010246\n[    4.332664] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    4.339800] RDX: ffffb47180037b38 RSI: 0000000000000001 RDI: ffffb47180037b80\n[    4.346949] RBP: ffff926143f388e8 R08: ffff926143f2f6f0 R09: ffff926143dd7000\n[    4.354083] R10: 0000000000000040 R11: ffffffff9ec58840 R12: ffff926143f00000\n[    4.361232] R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000\n[    4.368368] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    4.376469] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    4.382217] CR2: 0000000000000000 CR3: 000000009362e000 CR4: 00000000003506f0\n[    4.389366] Call Trace:\n[    4.391820]  <TASK>\n[    4.393943]  ? __warn+0x84/0x130\n[    4.397180]  ? __flush_work+0x2d6/0x300\n[    4.401037]  ? report_bug+0x164/0x190\n[    4.404713]  ? handle_bug+0x54/0x90\n[    4.408227]  ? exc_invalid_op+0x17/0x70\n[    4.412068]  ? asm_exc_invalid_op+0x1a/0x20\n[    4.416277]  ? __flush_work+0x2d6/0x300\n[    4.420122]  cancel_delayed_work_sync+0x5c/0x80\n[    4.424676]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    4.429218]  amdgpu_ring_alloc+0x3e/0x60\n[    4.433166]  amdgpu_jpeg_dec_ring_test_ring+0x30/0x180\n[    4.438323]  amdgpu_ring_test_helper+0x1b/0x90\n[    4.442773]  amdgpu_device_init+0x1e4f/0x2530\n[    4.447151]  amdgpu_driver_load_kms+0x14/0x80\n[    4.451515]  amdgpu_pci_probe+0x150/0x490\n[    4.455547]  local_pci_probe+0x3d/0x90\n[    4.459309]  pci_device_probe+0xb5/0x180\n[    4.463254]  really_probe+0xcc/0x2b0\n[    4.466839]  ? __pfx___driver_attach+0x10/0x10\n[    4.471300]  __driver_probe_device+0x6e/0x110\n[    4.475661]  driver_probe_device+0x1a/0xe0\n[    4.479781]  __driver_attach+0x83/0x180\n[    4.483624]  bus_for_each_dev+0x83/0xd0\n[    4.487481]  bus_add_driver+0xe3/0x210\n[    4.491238]  driver_register+0x54/0x100\n[    4.495093]  ? __pfx_amdgpu_init+0x10/0x10\n[    4.499197]  do_one_initcall+0x56/0x220\n[    4.503057]  kernel_init_freeable+0x19e/0x2d0\n[    4.507424]  ? __pfx_kernel_init+0x10/0x10\n[    4.511545]  kernel_init+0x15/0x1c0\n[    4.515039]  ret_from_fork+0x2f/0x50\n[    4.518636]  ? __pfx_kernel_init+0x10/0x10\n[    4.522737]  ret_from_fork_asm+0x1a/0x30\n[    4.526684]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}, {'origin': 'maestro', 'id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'version': 0, 'comment': '[logspec:generic_linux_boot] linux.kernel.warning WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'misc': {'logspec': {'version': '1.0.0', 'parser': 'generic_linux_boot', 'error': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'hardware': 'HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'call_trace': ['<TASK>', '? __warn+0x84/0x130', '? __flush_work+0x2d6/0x300', '? report_bug+0x164/0x190', '? handle_bug+0x54/0x90', '? exc_invalid_op+0x17/0x70', '? asm_exc_invalid_op+0x1a/0x20', '? __flush_work+0x2d6/0x300', 'cancel_delayed_work_sync+0x5c/0x80', 'jpeg_v1_0_ring_begin_use+0x1c/0xb0', 'amdgpu_ring_alloc+0x3e/0x60', 'amdgpu_ib_schedule+0xef/0x7f0', 'amdgpu_job_submit_direct+0x2c/0x50', 'amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290', 'amdgpu_ib_ring_tests+0x105/0x170', 'amdgpu_device_delayed_init_work_handler+0x10/0x30', 'process_one_work+0x163/0x390', 'worker_thread+0x2a0/0x3b0', '? __pfx_worker_thread+0x10/0x10', 'kthread+0xcb/0xf0', '? __pfx_kthread+0x10/0x10', 'ret_from_fork+0x2f/0x50', '? __pfx_kthread+0x10/0x10', 'ret_from_fork_asm+0x1a/0x30', '</TASK>'], 'modules': ['acp_audio_dma', 'acpi_als', 'bluetooth', 'btbcm', 'btintel', 'btmtk', 'btrtl', 'btusb', 'chromeos_pstore', 'coreboot_table', 'cros_charge_control', 'cros_ec_chardev', 'cros_ec_debugfs', 'cros_ec_dev', 'cros_ec_hwmon', 'cros_ec_sysfs', 'cros_ec_typec', 'cros_kbd_led_backlight', 'cros_usbpd_charger', 'cros_usbpd_logger', 'cros_usbpd_notify', 'elan_i2c', 'gsmi', 'i2c_cros_ec_tunnel', 'i2c_hid', 'i2c_hid_acpi', 'i2c_piix4', 'industrialio', 'industrialio_triggered_buffer', 'iwlmvm', 'iwlwifi', 'kfifo_buf', 'memconsole', 'memconsole_coreboot', 'raydium_i2c_ts', 'regmap_i2c', 'roles', 'snd_acp3x_i2s', 'snd_acp3x_pcm_dma', 'snd_acp_config', 'snd_compress', 'snd_pci_acp3x', 'snd_pcm_dmaengine', 'snd_soc_acp_da7219mx98357_mach', 'snd_soc_acp_rt5682_mach', 'snd_soc_acpi', 'snd_soc_core', 'snd_soc_cros_ec_codec', 'snd_soc_max98357a', 'snd_soc_rl6231', 'snd_soc_rt5682', 'snd_soc_rt5682_i2c', 'snd_sof', 'snd_sof_amd_acp', 'snd_sof_amd_rembrandt', 'snd_sof_amd_renoir', 'snd_sof_pci', 'snd_sof_utils', 'snd_sof_xtensa_dsp', 'sp5100_tco', 'typec', 'uvc', 'uvcvideo', 'videobuf2_common', 'videobuf2_memops', 'videobuf2_v4l2', 'videobuf2_vmalloc', 'vpd_sysfs', 'watchdog'], 'log_excerpt': '[    6.740747] WARNING: CPU: 1 PID: 29 at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300\n[    6.748757] Modules linked in: btusb btrtl btintel btbcm btmtk uvcvideo videobuf2_vmalloc videobuf2_memops uvc bluetooth videobuf2_v4l2 videobuf2_common snd_acp3x_pcm_dma snd_acp3x_i2s snd_sof_amd_rembrandt snd_sof_amd_renoir snd_sof_amd_acp snd_acp_config snd_sof_pci snd_sof_xtensa_dsp snd_soc_acp_rt5682_mach memconsole_coreboot cros_ec_hwmon cros_ec_chardev cros_ec_sysfs cros_charge_control cros_ec_debugfs cros_usbpd_charger vpd_sysfs cros_usbpd_logger memconsole gsmi snd_sof snd_sof_utils snd_soc_acpi snd_soc_rt5682_i2c acpi_als snd_soc_rt5682 snd_soc_acp_da7219mx98357_mach snd_soc_rl6231 sp5100_tco snd_soc_max98357a regmap_i2c acp_audio_dma watchdog cros_ec_typec industrialio_triggered_buffer iwlmvm snd_soc_cros_ec_codec kfifo_buf roles cros_ec_dev snd_pci_acp3x i2c_piix4 iwlwifi snd_soc_core chromeos_pstore typec cros_kbd_led_backlight snd_compress i2c_cros_ec_tunnel cros_usbpd_notify snd_pcm_dmaengine industrialio i2c_hid_acpi raydium_i2c_ts i2c_hid elan_i2c coreboot_table\n[    6.835381] CPU: 1 UID: 0 PID: 29 Comm: kworker/1:0 Tainted: G        W          6.12.0-next-20241122 #1\n[    6.844857] Tainted: [W]=WARN\n[    6.847829] Hardware name: HP Berknip/Berknip, BIOS Google_Berknip.13434.796.2023_03_03_1148 09/12/2022\n[    6.857218] Workqueue: events amdgpu_device_delayed_init_work_handler\n[    6.863662] RIP: 0010:__flush_work+0x2d6/0x300\n[    6.868110] Code: 70 9e 97 64 48 89 44 24 48 48 8b 53 40 8b 43 30 e9 81 fe ff ff 40 30 f6 4c 8b 3e e9 b9 fd ff ff 90 0f 0b 90 e9 31 ff ff ff 90 <0f> 0b 90 e9 28 ff ff ff 90 0f 0b 90 e9 a3 fe ff ff 90 0f 0b 90 e9\n[    6.886856] RSP: 0018:ffffb47180133c70 EFLAGS: 00010246\n[    6.892086] RAX: 0000000000000000 RBX: ffff926143f388e8 RCX: 0000000000000000\n[    6.899219] RDX: ffffb47180133c78 RSI: 0000000000000001 RDI: ffffb47180133cc0\n[    6.906350] RBP: ffff926143f388e8 R08: ffffb47180133df0 R09: 0000000000000000\n[    6.913485] R10: ffffb47180133b38 R11: 000000000006c99f R12: 00000000000003e8\n[    6.920617] R13: 0000000000000001 R14: ffff926143f00000 R15: ffff926143f323c0\n[    6.927756] FS:  0000000000000000(0000) GS:ffff926266e80000(0000) knlGS:0000000000000000\n[    6.935842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\n[    6.941591] CR2: 00007ffefc806598 CR3: 0000000105c42000 CR4: 00000000003506f0\n[    6.948723] Call Trace:\n[    6.951177]  <TASK>\n[    6.953285]  ? __warn+0x84/0x130\n[    6.956521]  ? __flush_work+0x2d6/0x300\n[    6.960363]  ? report_bug+0x164/0x190\n[    6.964036]  ? handle_bug+0x54/0x90\n[    6.967532]  ? exc_invalid_op+0x17/0x70\n[    6.971374]  ? asm_exc_invalid_op+0x1a/0x20\n[    6.975565]  ? __flush_work+0x2d6/0x300\n[    6.979408]  cancel_delayed_work_sync+0x5c/0x80\n[    6.983944]  jpeg_v1_0_ring_begin_use+0x1c/0xb0\n[    6.988484]  amdgpu_ring_alloc+0x3e/0x60\n[    6.992414]  amdgpu_ib_schedule+0xef/0x7f0\n[    6.996518]  amdgpu_job_submit_direct+0x2c/0x50\n[    7.001050]  amdgpu_jpeg_dec_ring_test_ib+0xd3/0x290\n[    7.006021]  amdgpu_ib_ring_tests+0x105/0x170\n[    7.010378]  amdgpu_device_delayed_init_work_handler+0x10/0x30\n[    7.016213]  process_one_work+0x163/0x390\n[    7.020229]  worker_thread+0x2a0/0x3b0\n[    7.023983]  ? __pfx_worker_thread+0x10/0x10\n[    7.028259]  kthread+0xcb/0xf0\n[    7.031320]  ? __pfx_kthread+0x10/0x10\n[    7.035072]  ret_from_fork+0x2f/0x50\n[    7.038655]  ? __pfx_kthread+0x10/0x10\n[    7.042409]  ret_from_fork_asm+0x1a/0x30\n[    7.046343]  </TASK>\n', 'signature_fields': {'error_type': 'linux.kernel.warning', 'error_summary': 'WARNING at kernel/workqueue.c:4192 __flush_work+0x2d6/0x300', 'location': 'kernel/workqueue.c:4192 __flush_work+0x2d6/0x300'}}}}, 'test_status': 'FAIL'}], 'incidents': [{'id': 'maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776', 'issue_id': 'maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a', 'issue_version': 0, 'test_id': 'maestro:67406ee211fb139cb87e1c85', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:01:48 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406ee211fb139cb87e1c85
11/22/2024 03:01:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:48 PM UTC [DEBUG] Sending to KCIDB: issues: maestro:e4a9aaa136a199bb99350d97b2080b34ef4e583a
11/22/2024 03:01:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776
11/22/2024 03:01:48 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6ae1ebaa953f7ab27dbe76f0dd021b79aaae9776
11/22/2024 03:20:37 PM UTC [INFO] Received an event for node: 66c9b9431aa40b1f2692ef96
11/22/2024 03:20:37 PM UTC [INFO] Received an event for node: 67406d1711fb139cb87dfae1
11/22/2024 03:20:38 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1711fb139cb87dfae1
11/22/2024 03:20:38 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1711fb139cb87dfae1
11/22/2024 03:20:51 PM UTC [INFO] Received an event for node: 66c9c21d1aa40b1f2692f371
11/22/2024 03:20:51 PM UTC [INFO] Received an event for node: 67406d1511fb139cb87dfad5
11/22/2024 03:20:52 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1511fb139cb87dfad5
11/22/2024 03:20:52 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1511fb139cb87dfad5
11/22/2024 03:21:16 PM UTC [INFO] Received an event for node: 673ff4b5a1a3e2eddf852763
11/22/2024 03:21:16 PM UTC [DEBUG] Not sending node to KCIDB: 673ff4b5a1a3e2eddf852763
11/22/2024 03:21:16 PM UTC [INFO] Received an event for node: 673ff4c4a1a3e2eddf852766
11/22/2024 03:21:16 PM UTC [DEBUG] Not sending node to KCIDB: 673ff4c4a1a3e2eddf852766
11/22/2024 03:21:46 PM UTC [INFO] Received an event for node: 66c9c2961aa40b1f2692f389
11/22/2024 03:21:46 PM UTC [INFO] Received an event for node: 67406d1611fb139cb87dfad8
11/22/2024 03:21:47 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1611fb139cb87dfad8
11/22/2024 03:21:47 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1611fb139cb87dfad8
11/22/2024 03:22:41 PM UTC [INFO] Received an event for node: 66c9c1f01aa40b1f2692f370
11/22/2024 03:22:41 PM UTC [INFO] Received an event for node: 67406d1711fb139cb87dfae4
11/22/2024 03:22:42 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:67406d1711fb139cb87dfae4
11/22/2024 03:22:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:67406d1711fb139cb87dfae4
11/22/2024 03:22:59 PM UTC [INFO] Received an event for node: 673fe580a1a3e2eddf84ff92
11/22/2024 03:22:59 PM UTC [DEBUG] Not sending node to KCIDB: 673fe580a1a3e2eddf84ff92
11/22/2024 03:23:00 PM UTC [INFO] Received an event for node: 673fe584a1a3e2eddf84ff95
11/22/2024 03:23:00 PM UTC [DEBUG] Not sending node to KCIDB: 673fe584a1a3e2eddf84ff95
11/22/2024 03:23:01 PM UTC [INFO] Received an event for node: 673fe589a1a3e2eddf84ff98
11/22/2024 03:23:01 PM UTC [DEBUG] Not sending node to KCIDB: 673fe589a1a3e2eddf84ff98
11/22/2024 03:23:01 PM UTC [INFO] Received an event for node: 673fe58ca1a3e2eddf84ff9b
11/22/2024 03:23:01 PM UTC [DEBUG] Not sending node to KCIDB: 673fe58ca1a3e2eddf84ff9b
11/22/2024 03:23:05 PM UTC [INFO] Received an event for node: 673fe55ba1a3e2eddf84ff80
11/22/2024 03:23:05 PM UTC [DEBUG] Not sending node to KCIDB: 673fe55ba1a3e2eddf84ff80
11/22/2024 03:23:06 PM UTC [INFO] Received an event for node: 673fe55ca1a3e2eddf84ff83
11/22/2024 03:23:06 PM UTC [DEBUG] Not sending node to KCIDB: 673fe55ca1a3e2eddf84ff83
11/22/2024 03:23:06 PM UTC [INFO] Received an event for node: 673fe55da1a3e2eddf84ff86
11/22/2024 03:23:06 PM UTC [DEBUG] Not sending node to KCIDB: 673fe55da1a3e2eddf84ff86
11/22/2024 03:23:06 PM UTC [INFO] Received an event for node: 673fe55ea1a3e2eddf84ff89
11/22/2024 03:23:06 PM UTC [DEBUG] Not sending node to KCIDB: 673fe55ea1a3e2eddf84ff89
11/22/2024 03:23:10 PM UTC [INFO] Received an event for node: 6740a1de11fb139cb87e314b
11/22/2024 03:23:10 PM UTC [DEBUG] Not sending node to KCIDB: 6740a1de11fb139cb87e314b
11/22/2024 03:23:10 PM UTC [INFO] Received an event for node: 6740704111fb139cb87e2075
11/22/2024 03:23:10 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740704111fb139cb87e2075
11/22/2024 03:23:10 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704111fb139cb87e2075
11/22/2024 03:23:18 PM UTC [INFO] Received an event for node: 6740a1e511fb139cb87e314e
11/22/2024 03:23:18 PM UTC [DEBUG] Not sending node to KCIDB: 6740a1e511fb139cb87e314e
11/22/2024 03:23:18 PM UTC [INFO] Received an event for node: 674071d111fb139cb87e2465
11/22/2024 03:23:19 PM UTC [INFO] Received an event for node: 6740a1e711fb139cb87e3151
11/22/2024 03:23:19 PM UTC [DEBUG] Not sending node to KCIDB: 6740a1e711fb139cb87e3151
11/22/2024 03:23:19 PM UTC [INFO] Received an event for node: 674071d111fb139cb87e2466
11/22/2024 03:23:20 PM UTC [INFO] Received an event for node: 6740a1e811fb139cb87e3154
11/22/2024 03:23:20 PM UTC [DEBUG] Not sending node to KCIDB: 6740a1e811fb139cb87e3154
11/22/2024 03:23:20 PM UTC [INFO] Received an event for node: 674071d111fb139cb87e2467
11/22/2024 03:23:23 PM UTC [INFO] Received an event for node: 673d6e6eccd91cf2493a5c9f
11/22/2024 03:23:23 PM UTC [DEBUG] Not sending node to KCIDB: 673d6e6eccd91cf2493a5c9f
11/22/2024 03:23:23 PM UTC [INFO] Received an event for node: 6740704311fb139cb87e207b
11/22/2024 03:23:23 PM UTC [WARNING] logspec: Could not generate any issues or incidents for test node maestro:6740704311fb139cb87e207b
11/22/2024 03:23:23 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740704311fb139cb87e207b
11/22/2024 03:23:24 PM UTC [INFO] Received an event for node: 673d6e79ccd91cf2493a5ca2
11/22/2024 03:23:24 PM UTC [DEBUG] Not sending node to KCIDB: 673d6e79ccd91cf2493a5ca2
11/22/2024 03:23:24 PM UTC [INFO] Received an event for node: 6740716d11fb139cb87e2313
11/22/2024 03:23:25 PM UTC [INFO] Received an event for node: 673d6e87ccd91cf2493a5ca5
11/22/2024 03:23:25 PM UTC [DEBUG] Not sending node to KCIDB: 673d6e87ccd91cf2493a5ca5
11/22/2024 03:23:25 PM UTC [INFO] Received an event for node: 6740716d11fb139cb87e2314
11/22/2024 03:23:25 PM UTC [INFO] Received an event for node: 673d6e95ccd91cf2493a5ca8
11/22/2024 03:23:25 PM UTC [DEBUG] Not sending node to KCIDB: 673d6e95ccd91cf2493a5ca8
11/22/2024 03:23:25 PM UTC [INFO] Received an event for node: 6740716d11fb139cb87e2315
11/22/2024 03:27:18 PM UTC [INFO] Received an event for node: 673fda81a1a3e2eddf84f4bd
11/22/2024 03:27:18 PM UTC [DEBUG] Not sending node to KCIDB: 673fda81a1a3e2eddf84f4bd
11/22/2024 03:27:19 PM UTC [INFO] Received an event for node: 673fda8ca1a3e2eddf84f4c8
11/22/2024 03:27:19 PM UTC [DEBUG] Not sending node to KCIDB: 673fda8ca1a3e2eddf84f4c8
11/22/2024 03:27:19 PM UTC [INFO] Received an event for node: 673fda8fa1a3e2eddf84f4cb
11/22/2024 03:27:19 PM UTC [DEBUG] Not sending node to KCIDB: 673fda8fa1a3e2eddf84f4cb
11/22/2024 03:27:19 PM UTC [INFO] Received an event for node: 673fda91a1a3e2eddf84f4ce
11/22/2024 03:27:19 PM UTC [DEBUG] Not sending node to KCIDB: 673fda91a1a3e2eddf84f4ce
11/22/2024 03:27:29 PM UTC [INFO] Received an event for node: 67337f33de3ba92e77bb6e74
11/22/2024 03:27:29 PM UTC [DEBUG] Not sending node to KCIDB: 67337f33de3ba92e77bb6e74
11/22/2024 03:27:31 PM UTC [INFO] Received an event for node: 67337f36de3ba92e77bb6e77
11/22/2024 03:27:31 PM UTC [DEBUG] Not sending node to KCIDB: 67337f36de3ba92e77bb6e77
11/22/2024 03:27:32 PM UTC [INFO] Received an event for node: 67337f39de3ba92e77bb6e7a
11/22/2024 03:27:32 PM UTC [DEBUG] Not sending node to KCIDB: 67337f39de3ba92e77bb6e7a
11/22/2024 03:27:32 PM UTC [INFO] Received an event for node: 67337f3bde3ba92e77bb6e7d
11/22/2024 03:27:32 PM UTC [DEBUG] Not sending node to KCIDB: 67337f3bde3ba92e77bb6e7d
11/22/2024 03:27:34 PM UTC [INFO] Received an event for node: 6712abff059076237ed2a922
11/22/2024 03:27:34 PM UTC [DEBUG] Not sending node to KCIDB: 6712abff059076237ed2a922
11/22/2024 03:27:34 PM UTC [INFO] Received an event for node: 674070b511fb139cb87e215b
11/22/2024 03:27:35 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070b511fb139cb87e215b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070b511fb139cb87e215b
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:18b77616a56f09ce3ac6afdbdcbc75d6a9b1a1c6
11/22/2024 03:27:35 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:a3e3077cca6ad77ce6969f0b22485d5ae05cb2ff
11/22/2024 03:27:57 PM UTC [INFO] Received an event for node: 6712ac12059076237ed2a923
11/22/2024 03:27:57 PM UTC [DEBUG] Not sending node to KCIDB: 6712ac12059076237ed2a923
11/22/2024 03:27:57 PM UTC [INFO] Received an event for node: 6740761a11fb139cb87e2f30
11/22/2024 03:28:26 PM UTC [INFO] Received an event for node: 6712ac2e059076237ed2a924
11/22/2024 03:28:26 PM UTC [DEBUG] Not sending node to KCIDB: 6712ac2e059076237ed2a924
11/22/2024 03:28:26 PM UTC [INFO] Received an event for node: 6740761a11fb139cb87e2f31
11/22/2024 03:28:53 PM UTC [INFO] Received an event for node: 67348d521efa5b87165ba84f
11/22/2024 03:28:53 PM UTC [DEBUG] Not sending node to KCIDB: 67348d521efa5b87165ba84f
11/22/2024 03:28:53 PM UTC [INFO] Received an event for node: 6740761a11fb139cb87e2f32
11/22/2024 03:30:42 PM UTC [INFO] Received an event for node: 673ff07ea1a3e2eddf852725
11/22/2024 03:30:42 PM UTC [DEBUG] Not sending node to KCIDB: 673ff07ea1a3e2eddf852725
11/22/2024 03:30:42 PM UTC [INFO] Received an event for node: 674076cf11fb139cb87e2f58
11/22/2024 03:31:09 PM UTC [INFO] Received an event for node: 673ff09da1a3e2eddf85272e
11/22/2024 03:31:09 PM UTC [DEBUG] Not sending node to KCIDB: 673ff09da1a3e2eddf85272e
11/22/2024 03:31:09 PM UTC [INFO] Received an event for node: 674076cf11fb139cb87e2f59
11/22/2024 03:31:35 PM UTC [INFO] Received an event for node: 673ff0b6a1a3e2eddf852731
11/22/2024 03:31:35 PM UTC [DEBUG] Not sending node to KCIDB: 673ff0b6a1a3e2eddf852731
11/22/2024 03:31:35 PM UTC [INFO] Received an event for node: 674076cf11fb139cb87e2f5a
11/22/2024 03:31:56 PM UTC [INFO] Received an event for node: 672cef1299c1e6dfcd9cbd2a
11/22/2024 03:31:56 PM UTC [DEBUG] Not sending node to KCIDB: 672cef1299c1e6dfcd9cbd2a
11/22/2024 03:31:56 PM UTC [INFO] Received an event for node: 674075b111fb139cb87e2f1a
11/22/2024 03:32:22 PM UTC [INFO] Received an event for node: 672cef3399c1e6dfcd9cbd43
11/22/2024 03:32:22 PM UTC [DEBUG] Not sending node to KCIDB: 672cef3399c1e6dfcd9cbd43
11/22/2024 03:32:22 PM UTC [INFO] Received an event for node: 674075b111fb139cb87e2f1b
11/22/2024 03:32:48 PM UTC [INFO] Received an event for node: 672cef5299c1e6dfcd9cbd4e
11/22/2024 03:32:48 PM UTC [DEBUG] Not sending node to KCIDB: 672cef5299c1e6dfcd9cbd4e
11/22/2024 03:32:48 PM UTC [INFO] Received an event for node: 674075b111fb139cb87e2f1c
11/22/2024 03:34:26 PM UTC [INFO] Received an event for node: 673fe5f2a1a3e2eddf850032
11/22/2024 03:34:26 PM UTC [DEBUG] Not sending node to KCIDB: 673fe5f2a1a3e2eddf850032
11/22/2024 03:34:27 PM UTC [INFO] Received an event for node: 673fe5f3a1a3e2eddf850035
11/22/2024 03:34:27 PM UTC [DEBUG] Not sending node to KCIDB: 673fe5f3a1a3e2eddf850035
11/22/2024 03:34:41 PM UTC [INFO] Received an event for node: 67348e841efa5b87165ba85c
11/22/2024 03:34:41 PM UTC [DEBUG] Not sending node to KCIDB: 67348e841efa5b87165ba85c
11/22/2024 03:34:41 PM UTC [INFO] Received an event for node: 674076da11fb139cb87e2f5c
11/22/2024 03:34:55 PM UTC [INFO] Received an event for node: 67348e921efa5b87165ba85f
11/22/2024 03:34:55 PM UTC [DEBUG] Not sending node to KCIDB: 67348e921efa5b87165ba85f
11/22/2024 03:34:55 PM UTC [INFO] Received an event for node: 674076da11fb139cb87e2f5d
11/22/2024 03:35:08 PM UTC [INFO] Received an event for node: 67348ea01efa5b87165ba862
11/22/2024 03:35:08 PM UTC [DEBUG] Not sending node to KCIDB: 67348ea01efa5b87165ba862
11/22/2024 03:35:08 PM UTC [INFO] Received an event for node: 674076da11fb139cb87e2f5e
11/22/2024 03:35:20 PM UTC [INFO] Received an event for node: 673ebddd8ef7ec14f2add214
11/22/2024 03:35:20 PM UTC [DEBUG] Not sending node to KCIDB: 673ebddd8ef7ec14f2add214
11/22/2024 03:35:20 PM UTC [INFO] Received an event for node: 6740763c11fb139cb87e2f44
11/22/2024 03:35:34 PM UTC [INFO] Received an event for node: 673ebded8ef7ec14f2add217
11/22/2024 03:35:34 PM UTC [DEBUG] Not sending node to KCIDB: 673ebded8ef7ec14f2add217
11/22/2024 03:35:34 PM UTC [INFO] Received an event for node: 6740763c11fb139cb87e2f45
11/22/2024 03:35:47 PM UTC [INFO] Received an event for node: 673ebdfa8ef7ec14f2add21a
11/22/2024 03:35:47 PM UTC [DEBUG] Not sending node to KCIDB: 673ebdfa8ef7ec14f2add21a
11/22/2024 03:35:47 PM UTC [INFO] Received an event for node: 6740763c11fb139cb87e2f46
11/22/2024 03:36:17 PM UTC [INFO] Received an event for node: 673ff019a1a3e2eddf852718
11/22/2024 03:36:17 PM UTC [DEBUG] Not sending node to KCIDB: 673ff019a1a3e2eddf852718
11/22/2024 03:36:17 PM UTC [INFO] Received an event for node: 6740765611fb139cb87e2f48
11/22/2024 03:36:47 PM UTC [INFO] Received an event for node: 673ff036a1a3e2eddf85271f
11/22/2024 03:36:47 PM UTC [DEBUG] Not sending node to KCIDB: 673ff036a1a3e2eddf85271f
11/22/2024 03:36:47 PM UTC [INFO] Received an event for node: 6740765611fb139cb87e2f49
11/22/2024 03:37:12 PM UTC [INFO] Received an event for node: 673ff051a1a3e2eddf852722
11/22/2024 03:37:12 PM UTC [DEBUG] Not sending node to KCIDB: 673ff051a1a3e2eddf852722
11/22/2024 03:37:12 PM UTC [INFO] Received an event for node: 6740765611fb139cb87e2f4a
11/22/2024 03:37:33 PM UTC [INFO] Received an event for node: 6738856f2632454f2f094b39
11/22/2024 03:37:33 PM UTC [DEBUG] Not sending node to KCIDB: 6738856f2632454f2f094b39
11/22/2024 03:37:33 PM UTC [INFO] Received an event for node: 6740763011fb139cb87e2f40
11/22/2024 03:38:00 PM UTC [INFO] Received an event for node: 673885892632454f2f094b3c
11/22/2024 03:38:00 PM UTC [DEBUG] Not sending node to KCIDB: 673885892632454f2f094b3c
11/22/2024 03:38:00 PM UTC [INFO] Received an event for node: 6740763011fb139cb87e2f41
11/22/2024 03:38:25 PM UTC [INFO] Received an event for node: 673885a32632454f2f094b3f
11/22/2024 03:38:25 PM UTC [DEBUG] Not sending node to KCIDB: 673885a32632454f2f094b3f
11/22/2024 03:38:25 PM UTC [INFO] Received an event for node: 6740763011fb139cb87e2f42
11/22/2024 03:38:51 PM UTC [INFO] Received an event for node: 6739e1d7f86469790fd95a0d
11/22/2024 03:38:51 PM UTC [DEBUG] Not sending node to KCIDB: 6739e1d7f86469790fd95a0d
11/22/2024 03:38:51 PM UTC [INFO] Received an event for node: 6740762311fb139cb87e2f38
11/22/2024 03:39:05 PM UTC [INFO] Received an event for node: 6739e1e7f86469790fd95a10
11/22/2024 03:39:05 PM UTC [DEBUG] Not sending node to KCIDB: 6739e1e7f86469790fd95a10
11/22/2024 03:39:05 PM UTC [INFO] Received an event for node: 6740762311fb139cb87e2f39
11/22/2024 03:39:18 PM UTC [INFO] Received an event for node: 6739e1f6f86469790fd95a13
11/22/2024 03:39:18 PM UTC [DEBUG] Not sending node to KCIDB: 6739e1f6f86469790fd95a13
11/22/2024 03:39:18 PM UTC [INFO] Received an event for node: 6740762311fb139cb87e2f3a
11/22/2024 03:39:34 PM UTC [INFO] Received an event for node: 673ff270a1a3e2eddf852742
11/22/2024 03:39:34 PM UTC [DEBUG] Not sending node to KCIDB: 673ff270a1a3e2eddf852742
11/22/2024 03:39:34 PM UTC [INFO] Received an event for node: 6740776311fb139cb87e2f74
11/22/2024 03:39:45 PM UTC [INFO] Received an event for node: 6740513baa97ccb0129416e9
11/22/2024 03:39:45 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740513baa97ccb0129416e9
11/22/2024 03:39:48 PM UTC [INFO] Received an event for node: 673ff27fa1a3e2eddf852745
11/22/2024 03:39:48 PM UTC [DEBUG] Not sending node to KCIDB: 673ff27fa1a3e2eddf852745
11/22/2024 03:39:49 PM UTC [INFO] Received an event for node: 6740776311fb139cb87e2f75
11/22/2024 03:40:02 PM UTC [INFO] Received an event for node: 673ff28da1a3e2eddf852748
11/22/2024 03:40:02 PM UTC [DEBUG] Not sending node to KCIDB: 673ff28da1a3e2eddf852748
11/22/2024 03:40:02 PM UTC [INFO] Received an event for node: 6740776311fb139cb87e2f76
11/22/2024 03:40:13 PM UTC [INFO] Received an event for node: 6728f3a039cae34cdd79fb9e
11/22/2024 03:40:13 PM UTC [DEBUG] Not sending node to KCIDB: 6728f3a039cae34cdd79fb9e
11/22/2024 03:40:13 PM UTC [INFO] Received an event for node: 6740766b11fb139cb87e2f54
11/22/2024 03:40:27 PM UTC [INFO] Received an event for node: 6728f3ad39cae34cdd79fba1
11/22/2024 03:40:27 PM UTC [DEBUG] Not sending node to KCIDB: 6728f3ad39cae34cdd79fba1
11/22/2024 03:40:27 PM UTC [INFO] Received an event for node: 6740766b11fb139cb87e2f55
11/22/2024 03:40:41 PM UTC [INFO] Received an event for node: 6728f3bb39cae34cdd79fba4
11/22/2024 03:40:41 PM UTC [DEBUG] Not sending node to KCIDB: 6728f3bb39cae34cdd79fba4
11/22/2024 03:40:41 PM UTC [INFO] Received an event for node: 6740766b11fb139cb87e2f56
11/22/2024 03:41:09 PM UTC [INFO] Received an event for node: 673ebef68ef7ec14f2add23c
11/22/2024 03:41:09 PM UTC [DEBUG] Not sending node to KCIDB: 673ebef68ef7ec14f2add23c
11/22/2024 03:41:09 PM UTC [INFO] Received an event for node: 6740762011fb139cb87e2f34
11/22/2024 03:41:39 PM UTC [INFO] Received an event for node: 673ebf118ef7ec14f2add246
11/22/2024 03:41:39 PM UTC [DEBUG] Not sending node to KCIDB: 673ebf118ef7ec14f2add246
11/22/2024 03:41:39 PM UTC [INFO] Received an event for node: 6740762011fb139cb87e2f35
11/22/2024 03:42:05 PM UTC [INFO] Received an event for node: 673ebf2e8ef7ec14f2add249
11/22/2024 03:42:05 PM UTC [DEBUG] Not sending node to KCIDB: 673ebf2e8ef7ec14f2add249
11/22/2024 03:42:05 PM UTC [INFO] Received an event for node: 6740762011fb139cb87e2f36
11/22/2024 03:42:11 PM UTC [INFO] Received an event for node: 6740a65311fb139cb87e31ae
11/22/2024 03:42:11 PM UTC [DEBUG] Not sending node to KCIDB: 6740a65311fb139cb87e31ae
11/22/2024 03:42:11 PM UTC [INFO] Received an event for node: 674070da11fb139cb87e2207
11/22/2024 03:42:12 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bb4d9c9c0e48d5f0ade5ef59d061b2447647c99d', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070da11fb139cb87e2207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6d43d7e71bea5931ec54c68b8dcdd138150d0095', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070da11fb139cb87e2207', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:42:12 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070da11fb139cb87e2207
11/22/2024 03:42:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bb4d9c9c0e48d5f0ade5ef59d061b2447647c99d
11/22/2024 03:42:12 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6d43d7e71bea5931ec54c68b8dcdd138150d0095
11/22/2024 03:42:16 PM UTC [INFO] Received an event for node: 6740a65811fb139cb87e31b1
11/22/2024 03:42:16 PM UTC [DEBUG] Not sending node to KCIDB: 6740a65811fb139cb87e31b1
11/22/2024 03:42:16 PM UTC [INFO] Received an event for node: 6740727011fb139cb87e287c
11/22/2024 03:42:17 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ec8c0a9983689ad00f4956365a40bf3f533c7d39', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e287c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:4b6ae8009ebb1fa158941b75fdbedf1952c1c9b4', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e287c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:42:17 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e287c
11/22/2024 03:42:17 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ec8c0a9983689ad00f4956365a40bf3f533c7d39
11/22/2024 03:42:17 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4b6ae8009ebb1fa158941b75fdbedf1952c1c9b4
11/22/2024 03:42:38 PM UTC [INFO] Received an event for node: 6740a66e11fb139cb87e31b4
11/22/2024 03:42:38 PM UTC [DEBUG] Not sending node to KCIDB: 6740a66e11fb139cb87e31b4
11/22/2024 03:42:39 PM UTC [INFO] Received an event for node: 6740727011fb139cb87e28c6
11/22/2024 03:42:39 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:585553e70d9b18c9b4bf6a130b0c4e1e39130559', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fe60635e40414a44342baa4e91671bd88da8fc9e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c6', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:42:39 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c6
11/22/2024 03:42:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:585553e70d9b18c9b4bf6a130b0c4e1e39130559
11/22/2024 03:42:39 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fe60635e40414a44342baa4e91671bd88da8fc9e
11/22/2024 03:42:40 PM UTC [INFO] Received an event for node: 6740a67011fb139cb87e31b7
11/22/2024 03:42:40 PM UTC [DEBUG] Not sending node to KCIDB: 6740a67011fb139cb87e31b7
11/22/2024 03:42:40 PM UTC [INFO] Received an event for node: 6740727011fb139cb87e28c8
11/22/2024 03:42:41 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:73ba871e3adbe55e0384e04ad1a2ebdb3909c2cc', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:c85b81c08bb001e8a17a752b36dc0a6581a15268', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c8', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:42:41 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c8
11/22/2024 03:42:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:73ba871e3adbe55e0384e04ad1a2ebdb3909c2cc
11/22/2024 03:42:41 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:c85b81c08bb001e8a17a752b36dc0a6581a15268
11/22/2024 03:42:41 PM UTC [INFO] Received an event for node: 6740a67011fb139cb87e31ba
11/22/2024 03:42:41 PM UTC [DEBUG] Not sending node to KCIDB: 6740a67011fb139cb87e31ba
11/22/2024 03:42:41 PM UTC [INFO] Received an event for node: 6740727011fb139cb87e28c9
11/22/2024 03:42:42 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ee6bc6769065c9c6468da7b9e011b503c5c1bb20', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6654d34c34edb1c4d1d9966b3d5822c931ce591c', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740727011fb139cb87e28c9', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:42:42 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740727011fb139cb87e28c9
11/22/2024 03:42:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ee6bc6769065c9c6468da7b9e011b503c5c1bb20
11/22/2024 03:42:42 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6654d34c34edb1c4d1d9966b3d5822c931ce591c
11/22/2024 03:43:02 PM UTC [INFO] Received an event for node: 6740a68611fb139cb87e31bd
11/22/2024 03:43:02 PM UTC [DEBUG] Not sending node to KCIDB: 6740a68611fb139cb87e31bd
11/22/2024 03:43:02 PM UTC [INFO] Received an event for node: 674070dc11fb139cb87e220a
11/22/2024 03:43:02 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:b257026c1c1916f36b0e5f8f762917ff488cc5f3', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070dc11fb139cb87e220a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:964f8a16eff59bb2c1ec1184749352abf7872bd2', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070dc11fb139cb87e220a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:02 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dc11fb139cb87e220a
11/22/2024 03:43:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:b257026c1c1916f36b0e5f8f762917ff488cc5f3
11/22/2024 03:43:02 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:964f8a16eff59bb2c1ec1184749352abf7872bd2
11/22/2024 03:43:07 PM UTC [INFO] Received an event for node: 6740a68b11fb139cb87e31c0
11/22/2024 03:43:07 PM UTC [DEBUG] Not sending node to KCIDB: 6740a68b11fb139cb87e31c0
11/22/2024 03:43:07 PM UTC [INFO] Received an event for node: 6740744711fb139cb87e2d3e
11/22/2024 03:43:08 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:ac9043c8c7e19554ed88ec40dee90fc69d22592c', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:74fc69d8e7c59ccc46fbb669d986e5dba80bc709', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d3e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:08 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d3e
11/22/2024 03:43:08 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:ac9043c8c7e19554ed88ec40dee90fc69d22592c
11/22/2024 03:43:08 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:74fc69d8e7c59ccc46fbb669d986e5dba80bc709
11/22/2024 03:43:30 PM UTC [INFO] Received an event for node: 6740a6a211fb139cb87e31c3
11/22/2024 03:43:30 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6a211fb139cb87e31c3
11/22/2024 03:43:30 PM UTC [INFO] Received an event for node: 6740744711fb139cb87e2d88
11/22/2024 03:43:31 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f1bbba4b12fe18baabf1b28096222ef27ba15ff5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:41451385b730d2e9247919fe22639c088ffbc776', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d88', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:31 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d88
11/22/2024 03:43:31 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f1bbba4b12fe18baabf1b28096222ef27ba15ff5
11/22/2024 03:43:31 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:41451385b730d2e9247919fe22639c088ffbc776
11/22/2024 03:43:31 PM UTC [INFO] Received an event for node: 6740a6a311fb139cb87e31c6
11/22/2024 03:43:31 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6a311fb139cb87e31c6
11/22/2024 03:43:31 PM UTC [INFO] Received an event for node: 6740744711fb139cb87e2d8a
11/22/2024 03:43:33 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f2a4ee0bcb9d139eccaed6b8f2f25960439f4a74', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:5411b437fc3b4a04774902414441a20448b1b74e', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8a', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:33 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8a
11/22/2024 03:43:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f2a4ee0bcb9d139eccaed6b8f2f25960439f4a74
11/22/2024 03:43:33 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:5411b437fc3b4a04774902414441a20448b1b74e
11/22/2024 03:43:33 PM UTC [INFO] Received an event for node: 6740a6a411fb139cb87e31c9
11/22/2024 03:43:33 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6a411fb139cb87e31c9
11/22/2024 03:43:33 PM UTC [INFO] Received an event for node: 6740744711fb139cb87e2d8b
11/22/2024 03:43:34 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:bd60160e2a701d9effe831fb17976b564e1646e4', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:31d7d10e7e27ea859a6baf56bd4d2c7276a724c9', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740744711fb139cb87e2d8b', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:34 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740744711fb139cb87e2d8b
11/22/2024 03:43:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:bd60160e2a701d9effe831fb17976b564e1646e4
11/22/2024 03:43:34 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:31d7d10e7e27ea859a6baf56bd4d2c7276a724c9
11/22/2024 03:43:55 PM UTC [INFO] Received an event for node: 6740a6bb11fb139cb87e31cc
11/22/2024 03:43:55 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6bb11fb139cb87e31cc
11/22/2024 03:43:55 PM UTC [INFO] Received an event for node: 674070dd11fb139cb87e2215
11/22/2024 03:43:56 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:3d116efb2808dbf6f58fb924a30d6d6e2afc12cd', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070dd11fb139cb87e2215', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a84e76ef889d5249fa06e33a70bbd7ceaecb907', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070dd11fb139cb87e2215', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:43:56 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070dd11fb139cb87e2215
11/22/2024 03:43:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:3d116efb2808dbf6f58fb924a30d6d6e2afc12cd
11/22/2024 03:43:56 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a84e76ef889d5249fa06e33a70bbd7ceaecb907
11/22/2024 03:44:00 PM UTC [INFO] Received an event for node: 6740a6c011fb139cb87e31cf
11/22/2024 03:44:00 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6c011fb139cb87e31cf
11/22/2024 03:44:00 PM UTC [INFO] Received an event for node: 6740731811fb139cb87e2a52
11/22/2024 03:44:01 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:e80e153cd21cee2558edb2df7b988e51fa75c171', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fa8d5a1d7c3e962a5fba3d8ac7e809eacab30069', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a52', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:01 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a52
11/22/2024 03:44:01 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e80e153cd21cee2558edb2df7b988e51fa75c171
11/22/2024 03:44:01 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fa8d5a1d7c3e962a5fba3d8ac7e809eacab30069
11/22/2024 03:44:24 PM UTC [INFO] Received an event for node: 6740a6d811fb139cb87e31d2
11/22/2024 03:44:24 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6d811fb139cb87e31d2
11/22/2024 03:44:24 PM UTC [INFO] Received an event for node: 6740731811fb139cb87e2a9c
11/22/2024 03:44:25 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:2cc61f8c943a42fc13d6a04cede35bdd017a3607', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:7a930b1ceaa6f507a9a2478efd929b685d42ce48', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9c', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:25 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9c
11/22/2024 03:44:25 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2cc61f8c943a42fc13d6a04cede35bdd017a3607
11/22/2024 03:44:25 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7a930b1ceaa6f507a9a2478efd929b685d42ce48
11/22/2024 03:44:25 PM UTC [INFO] Received an event for node: 6740a6d911fb139cb87e31d5
11/22/2024 03:44:25 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6d911fb139cb87e31d5
11/22/2024 03:44:25 PM UTC [INFO] Received an event for node: 6740731811fb139cb87e2a9e
11/22/2024 03:44:26 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7f3fa1d9022eb9d6f56db88ad03ec57303c78a94', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:f84900d814181c00125ba114ab9b62ffdc2b7179', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9e', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:26 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9e
11/22/2024 03:44:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7f3fa1d9022eb9d6f56db88ad03ec57303c78a94
11/22/2024 03:44:26 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f84900d814181c00125ba114ab9b62ffdc2b7179
11/22/2024 03:44:26 PM UTC [INFO] Received an event for node: 6740a6da11fb139cb87e31d8
11/22/2024 03:44:26 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6da11fb139cb87e31d8
11/22/2024 03:44:26 PM UTC [INFO] Received an event for node: 6740731811fb139cb87e2a9f
11/22/2024 03:44:27 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:670f8e5abbda72133b2df20598e6ec2af539c51a', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:6898a7fa905ec92d4a8019f7de479740e9be5f4d', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740731811fb139cb87e2a9f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:27 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740731811fb139cb87e2a9f
11/22/2024 03:44:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:670f8e5abbda72133b2df20598e6ec2af539c51a
11/22/2024 03:44:27 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:6898a7fa905ec92d4a8019f7de479740e9be5f4d
11/22/2024 03:44:45 PM UTC [INFO] Received an event for node: 6740a6ed11fb139cb87e31db
11/22/2024 03:44:45 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6ed11fb139cb87e31db
11/22/2024 03:44:45 PM UTC [INFO] Received an event for node: 674070de11fb139cb87e2220
11/22/2024 03:44:46 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:f18cb9f937c86a90c54d8a36c4a2aaa49fe02622', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:674070de11fb139cb87e2220', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:232fc56dd60aab3e01897e0e9e5ada8d7099e249', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:674070de11fb139cb87e2220', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:46 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:674070de11fb139cb87e2220
11/22/2024 03:44:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:f18cb9f937c86a90c54d8a36c4a2aaa49fe02622
11/22/2024 03:44:46 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:232fc56dd60aab3e01897e0e9e5ada8d7099e249
11/22/2024 03:44:51 PM UTC [INFO] Received an event for node: 6740a6f211fb139cb87e31de
11/22/2024 03:44:51 PM UTC [DEBUG] Not sending node to KCIDB: 6740a6f211fb139cb87e31de
11/22/2024 03:44:51 PM UTC [INFO] Received an event for node: 6740720811fb139cb87e2605
11/22/2024 03:44:51 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:9e4787b7d3c9d47e0e8887db26074bd14ba11360', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2605', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:fcec82a6cba9e2931c85f39c5c4da4efb63833c0', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2605', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:44:51 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2605
11/22/2024 03:44:51 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:9e4787b7d3c9d47e0e8887db26074bd14ba11360
11/22/2024 03:44:51 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:fcec82a6cba9e2931c85f39c5c4da4efb63833c0
11/22/2024 03:45:12 PM UTC [INFO] Received an event for node: 6740a70811fb139cb87e31e1
11/22/2024 03:45:12 PM UTC [DEBUG] Not sending node to KCIDB: 6740a70811fb139cb87e31e1
11/22/2024 03:45:12 PM UTC [INFO] Received an event for node: 6740720811fb139cb87e264f
11/22/2024 03:45:13 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:0ebc987e56bcb03b7b78731a5ab293eb141616d5', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e264f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:e4dd4651961efc0c90e1a1d1158495b2f6f76ef8', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e264f', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:45:13 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e264f
11/22/2024 03:45:13 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:0ebc987e56bcb03b7b78731a5ab293eb141616d5
11/22/2024 03:45:13 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:e4dd4651961efc0c90e1a1d1158495b2f6f76ef8
11/22/2024 03:45:13 PM UTC [INFO] Received an event for node: 6740a70911fb139cb87e31e4
11/22/2024 03:45:13 PM UTC [DEBUG] Not sending node to KCIDB: 6740a70911fb139cb87e31e4
11/22/2024 03:45:13 PM UTC [INFO] Received an event for node: 6740720811fb139cb87e2651
11/22/2024 03:45:14 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:7b5ce0ae59daa2a85e46892cab9604bb152775d9', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2651', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:2d2bb8ae042931840ef64e7ad801ebc248240732', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2651', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:45:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2651
11/22/2024 03:45:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:7b5ce0ae59daa2a85e46892cab9604bb152775d9
11/22/2024 03:45:14 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:2d2bb8ae042931840ef64e7ad801ebc248240732
11/22/2024 03:45:14 PM UTC [INFO] Received an event for node: 6740a70911fb139cb87e31e7
11/22/2024 03:45:14 PM UTC [DEBUG] Not sending node to KCIDB: 6740a70911fb139cb87e31e7
11/22/2024 03:45:14 PM UTC [INFO] Received an event for node: 6740720811fb139cb87e2652
11/22/2024 03:45:15 PM UTC [DEBUG] Generated issues/incidents: {'incidents': [{'id': 'maestro:4c77115576d2cc3d9def50df8e15b4e45c521392', 'issue_id': 'maestro:26cab82e27e6b4a7e883e14b72220126b0206e4e', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2652', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}, {'id': 'maestro:485201f2f5244fedd5206976ebe52ecf28e60dbd', 'issue_id': 'maestro:864a51178bf5750110198e325f2a58c7b13978b7', 'issue_version': 0, 'test_id': 'maestro:6740720811fb139cb87e2652', 'comment': 'test incident, automatically generated', 'origin': 'maestro', 'present': True}]}
11/22/2024 03:45:15 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740720811fb139cb87e2652
11/22/2024 03:45:15 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:4c77115576d2cc3d9def50df8e15b4e45c521392
11/22/2024 03:45:15 PM UTC [DEBUG] Sending to KCIDB: incidents: maestro:485201f2f5244fedd5206976ebe52ecf28e60dbd
11/22/2024 03:45:50 PM UTC [INFO] Received an event for node: 6740a72e11fb139cb87e31ea
11/22/2024 03:45:50 PM UTC [DEBUG] Not sending node to KCIDB: 6740a72e11fb139cb87e31ea
11/22/2024 03:45:50 PM UTC [INFO] Received an event for node: 6740782d11fb139cb87e2f78
11/22/2024 03:46:17 PM UTC [INFO] Received an event for node: 6740a74911fb139cb87e31ed
11/22/2024 03:46:17 PM UTC [DEBUG] Not sending node to KCIDB: 6740a74911fb139cb87e31ed
11/22/2024 03:46:17 PM UTC [INFO] Received an event for node: 6740782d11fb139cb87e2f79
11/22/2024 03:46:45 PM UTC [INFO] Received an event for node: 6740a76511fb139cb87e31f0
11/22/2024 03:46:45 PM UTC [DEBUG] Not sending node to KCIDB: 6740a76511fb139cb87e31f0
11/22/2024 03:46:46 PM UTC [INFO] Received an event for node: 6740782d11fb139cb87e2f7a
11/22/2024 03:47:07 PM UTC [INFO] Received an event for node: 673ec0038ef7ec14f2add261
11/22/2024 03:47:07 PM UTC [DEBUG] Not sending node to KCIDB: 673ec0038ef7ec14f2add261
11/22/2024 03:47:07 PM UTC [INFO] Received an event for node: 674075f311fb139cb87e2f28
11/22/2024 03:47:33 PM UTC [INFO] Received an event for node: 673ec01d8ef7ec14f2add264
11/22/2024 03:47:33 PM UTC [DEBUG] Not sending node to KCIDB: 673ec01d8ef7ec14f2add264
11/22/2024 03:47:34 PM UTC [INFO] Received an event for node: 674075f311fb139cb87e2f29
11/22/2024 03:47:59 PM UTC [INFO] Received an event for node: 673ec0378ef7ec14f2add267
11/22/2024 03:47:59 PM UTC [DEBUG] Not sending node to KCIDB: 673ec0378ef7ec14f2add267
11/22/2024 03:47:59 PM UTC [INFO] Received an event for node: 674075f311fb139cb87e2f2a
11/22/2024 04:19:51 PM UTC [INFO] Received an event for node: 6740aede11fb139cb87e31f9
11/22/2024 04:19:51 PM UTC [DEBUG] Sending to KCIDB: checkouts: maestro:6740aede11fb139cb87e31f9
11/22/2024 04:20:14 PM UTC [INFO] Received an event for node: 6740af2711fb139cb87e31fc
11/22/2024 04:20:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: shell
11/22/2024 04:20:14 PM UTC [DEBUG] Sending to KCIDB: builds: maestro:dummy_6740aede11fb139cb87e31f9
11/22/2024 04:20:14 PM UTC [DEBUG] Sending to KCIDB: tests: maestro:6740af2711fb139cb87e31fc
11/22/2024 04:22:53 PM UTC [INFO] Received an event for node: 6740af3711fb139cb87e323b
11/22/2024 04:22:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:22:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:19 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:20 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:21 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:22 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:23 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:24 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:25 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:26 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:27 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:28 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:29 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:30 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:31 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:32 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:33 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:34 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:35 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:36 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:37 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:38 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:39 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:40 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:41 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:42 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:43 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:44 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:45 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:46 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:47 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:48 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:49 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:50 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:51 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:52 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:53 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:54 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:55 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:56 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:57 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:58 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:23:59 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:00 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:01 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:02 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:03 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:04 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:05 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:06 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:07 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:08 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:09 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:10 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:11 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:12 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:13 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:14 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:15 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:16 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:17 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [WARNING] LAVA lab URL not found in the mapping for: None
11/22/2024 04:24:18 PM UTC [INFO] Stopping.